00000001:02000400:2.0F:1789117201.959088:0:2954:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg637-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1789117222.908935:0:3175:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg637-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1789117225.181515:0:3239:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 919 MB/s 00000001:01000000:2.0:1789117225.432432:0:3239:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1390 MB/s 00000001:01000000:3.0F:1789117225.682544:0:3239:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 9379 MB/s 00000020:02000000:0.0:1789117226.414088:0:3268:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_140_g76d5844 00000400:02000000:2.0:1789117227.621844:0:3282:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.137@tcp [8/256/0/180] 00008000:02000000:1.0:1789117231.707981:0:3432:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1789117282.666383:0:5247:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg637-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789117295.308043:0:5820:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789117295.308048:0:5820:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789117295.308150:0:5820:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000002d6f8a6c 00000080:02000400:2.0:1789117295.308161:0:5820:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1789117295.316960:0:5820:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1789117295.316973:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789117295.317009:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000008d690c71) 00000020:00000080:2.0:1789117295.317024:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789117295.353067:0:5820:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789117295.353477:0:5820:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789117295.390664:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789117295.390704:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789117295.390725:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789117295.390776:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789117295.390800:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789117295.391118:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789117295.391126:0:5820:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789117295.391136:0:5820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7565228e460d900 00000020:01000004:2.0:1789117295.391142:0:5820:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789117295.391147:0:5820:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789117295.391150:0:5820:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002d6f8a6c from MGS 00000020:01000004:2.0:1789117295.391154:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789117295.391162:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000009b1b22fd) 00000020:00000080:2.0:1789117295.391171:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789117295.391217:0:5820:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002d6f8a6c from MGS, refs=2 00080000:01000000:2.0:1789117295.391222:0:5820:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789117295.391227:0:5820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7565228e460d90e 00000100:00100000:2.0:1789117295.391394:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789117295.391828:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789117295.391834:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789117295.392392:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789117295.392598:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789117295.393244:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789117295.393785:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789117295.393791:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789117295.394603:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789117295.394611:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789117295.394908:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789117295.394913:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789117295.395864:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117295.395867:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117295.395868:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117295.396078:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117295.396080:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117295.396081:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117295.398651:0:5820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789117295.399451:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1789117295.651027:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2225 MB/s 00000001:01000000:3.0:1789117295.900544:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1779 MB/s 00000001:01000000:2.0:1789117296.150505:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 971 MB/s 00000001:01000000:3.0:1789117296.400525:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 995 MB/s 00080000:10000000:3.0:1789117296.405602:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1789117296.421332:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789117296.421348:0:5820:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789117296.421351:0:5820:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789117296.424477:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789117296.424543:0:5820:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789117296.424586:0:5820:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789117296.424780:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789117296.424829:0:5820:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789117296.427082:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789117296.427282:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789117296.427288:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789117296.427917:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789117296.427924:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789117296.428357:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789117296.428371:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789117296.429098:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789117296.429115:0:5820:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.137@tcp' 00000020:01000004:2.0:1789117296.429117:0:5820:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789117296.429203:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.137@tcp (typ=mgc) 00000020:00000080:2.0:1789117296.429214:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.137@tcp (00000000c6f7a2f0) 00000020:00000080:2.0:1789117296.429233:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:3.0:1789117296.429257:0:5836:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:2.0:1789117296.429306:0:5820:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002b629435@MGC192.168.206.137@tcp: add connection 192.168.206.137@tcp at head 00010000:00010000:2.0:1789117296.429460:0:5820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.137@tcp-0 is initialized 00000040:01000000:2.0:1789117296.429476:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.137@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789117296.432020:0:5837:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789117296.432075:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.137@tcp (uuid 6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8) 00000020:00000080:2.0:1789117296.432164:0:5820:0:(genops.c:1385:class_connect()) connect: client 6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8, cookie 0xf7565228e460d91c 00000100:00080000:2.0:1789117296.432175:0:5820:0:(import.c:510:import_select_connection()) MGC192.168.206.137@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789117296.432180:0:5820:0:(import.c:624:import_select_connection()) MGC192.168.206.137@tcp: import 000000002b629435 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:2.0:1789117296.432208:0:5820:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000010789536 x1876025385418880/t0(0) o250->MGC192.168.206.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789117296.432240:0:5820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8->MGS 00000020:01000004:2.0:1789117296.432311:0:5820:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789117296.432316:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789117296.432327:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000ce852e3c) 00000020:00000080:2.0:1789117296.432338:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789117296.432615:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010789536 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3297:1876025385418880:0@lo:250: 00000100:00100000:0.0:1789117296.432671:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117296.432730:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385418880 00000100:00100000:0.0:1789117296.432736:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385418880 00000100:00100000:0.0:1789117296.432769:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117296.432775:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e32d72f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3297:x1876025385418880:12345-0@lo:250: 00010000:00080000:0.0:1789117296.432794:0:5833:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8@0@lo t0 exp 0000000000000000 cur 143 last 0 00000020:00000080:0.0:1789117296.432814:0:5833:0:(genops.c:1385:class_connect()) connect: client 6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8, cookie 0xf7565228e460d92a 00000100:00080000:0.0:1789117296.432928:0:5833:0:(import.c:65:import_set_state_nolock()) 00000000ac872c24 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789117296.433040:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e32d72f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+5:3297:x1876025385418880:12345-0@lo:250: Request processed in 264us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117296.433049:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117296.433139:0:3297:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.137@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789117296.433147:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.137@tcp: connect to target with instance 0 00000100:00080000:0.0:1789117296.433155:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.137@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789117296.433159:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789117296.433161:0:3297:0:(import.c:65:import_set_state_nolock()) 000000002b629435 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789117296.433164:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789117296.433172:0:3297:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789117296.433177:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010789536 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3297:1876025385418880:0@lo:250: 00000100:00100000:2.0:1789117296.440318:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789117296.440527:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789117296.440533:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789117296.441108:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789117296.441116:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789117296.441395:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789117296.441432:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789117296.442151:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789117296.442328:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789117296.442334:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789117296.442983:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789117296.442990:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:3.0:1789117296.454901:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117296.470071:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789117296.470268:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789117296.470274:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789117296.471226:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789117296.471233:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789117296.471867:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789117296.472033:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789117296.472038:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789117296.472527:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789117296.472533:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789117296.473041:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789117296.473189:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789117296.473195:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789117296.473657:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789117296.473663:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789117296.474257:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789117296.474382:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789117296.474395:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789117296.474869:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789117296.474876:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789117296.499702:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789117296.499910:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789117296.499917:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789117296.503150:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789117296.503163:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789117296.505186:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789117296.505201:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789117296.506940:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789117296.506974:0:5820:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789117296.506979:0:5820:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.137@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789117296.507099:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.137@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789117296.507135:0:5820:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.137@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789117296.507139:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789117296.507141:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789117296.507142:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117296.507143:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789117296.507144:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117296.507145:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117296.507146:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789117296.507148:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789117296.507149:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789117296.507150:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789117296.507151:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117296.507153:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789117296.507155:0:5820:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789117296.507156:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789117296.507157:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789117296.507158:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117296.507163:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789117296.507164:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117296.507165:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117296.507165:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789117296.507166:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789117296.507167:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789117296.507168:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789117296.507169:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117296.507170:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789117296.507191:0:5820:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789117296.507204:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053614b5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385419008:0@lo:253: 00000100:00100000:2.0:1789117296.507271:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117296.507315:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a47b0e0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117296.507542:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385419008 00000100:00100000:3.0:1789117296.507553:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385419008 00000100:00100000:3.0:1789117296.507602:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789117296.507609:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbe9b875 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+5:5820:x1876025385419008:12345-0@lo:253: 20000000:01000000:3.0:1789117296.507648:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789117296.507651:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789117296.509523:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789117296.509580:0:5835:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789117296.509865:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789117296.511123:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1789117296.511316:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789117296.511320:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1789117296.511326:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1789117296.511328:0:5835:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1789117296.511341:0:5835:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1789117296.511735:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789117296.512079:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1789117296.512092:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789117296.512133:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1789117296.512173:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1789117296.512205:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1789117296.512282:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1789117296.512290:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1789117296.512339:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1789117296.512747:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1789117296.512795:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1789117296.512802:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1789117296.512828:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1789117296.512872:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1789117296.513226:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789117296.513239:0:5835:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1789117296.513253:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789117296.513480:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1789117296.513491:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789117296.513523:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1789117296.513551:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1789117296.513590:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1789117296.513599:0:5835:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1789117296.513661:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1789117296.513669:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789117296.513706:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1789117296.513736:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1789117296.513765:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1789117296.513774:0:5835:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1789117296.513842:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1789117296.513849:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1789117296.513889:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1789117296.513932:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1789117296.514086:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1789117296.514127:0:5835:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789117296.514135:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1789117296.515114:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1789117296.515453:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1789117296.515478:0:5835:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.137@tcp for mdt 20000000:01000000:0.0:1789117296.515480:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.137@tcp (null) (null) (null) 00000040:00080000:0.0:1789117296.515516:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1789117296.515524:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789117296.515555:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1789117296.515575:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.137@tcp (null) (null) 00000040:00080000:0.0:1789117296.515625:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1789117296.515635:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789117296.515668:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1789117296.515721:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1789117296.515787:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789117296.515791:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789117296.515797:0:5835:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789117296.515802:0:5835:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789117296.517207:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1789117296.517323:0:5835:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789117296.523120:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789117296.523164:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1789117296.523248:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1789117296.523264:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789117296.523267:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789117296.523270:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789117296.523290:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789117296.523292:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789117296.523320:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789117296.523325:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789117296.523795:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789117296.524077:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789117296.524112:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789117296.524140:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1789117296.524150:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789117296.524151:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789117296.524619:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1789117296.524781:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1789117296.524815:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1789117296.524861:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:0.0:1789117296.524874:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789117296.524876:0:5835:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1789117296.524882:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789117296.524898:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002cd35a50/0xf7565228e460d931 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117296.524912:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002cd35a50/0xf7565228e460d931 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117296.524921:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002cd35a50/0xf7565228e460d931 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117296.524928:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002cd35a50/0xf7565228e460d931 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117296.524933:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002cd35a50/0xf7565228e460d931 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117296.524959:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002cd35a50/0xf7565228e460d931 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117296.524966:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002cd35a50 already unused, calling callback (0000000035f530b4) 00010000:00010000:0.0:1789117296.524969:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002cd35a50/0xf7565228e460d931 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117296.524976:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002cd35a50/0xf7565228e460d931 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117296.524987:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002cd35a50/0xf7565228e460d931 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117296.524994:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002cd35a50/0xf7565228e460d931 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117296.524999:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002cd35a50/0xf7565228e460d931 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789117296.525015:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789117296.816246:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbe9b875 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+5:5820:x1876025385419008:12345-0@lo:253: Request processed in 308631us (308969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117296.816270:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117296.816507:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053614b5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385419008:0@lo:253: 10000000:01000000:2.0:1789117296.816521:0:5820:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789117296.816524:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789117296.816525:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789117296.816527:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117296.816528:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789117296.816529:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117296.816531:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117296.816532:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789117296.816533:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789117296.816534:0:5820:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789117296.816536:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117296.816537:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789117296.816556:0:5820:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002d6f8a6c from lustre-MDT0000 10000000:01000000:2.0:1789117296.816588:0:5820:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789117296.816591:0:5820:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789117296.816594:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c17882d4ed8 10000000:01000000:2.0:1789117296.816597:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789117296.816603:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c17882d4ed8 from 1 10000000:01000000:2.0:1789117296.816606:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789117296.816634:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: 00000000ceb9cf7e/0xf7565228e460d938 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117296.816644:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: 00000000ceb9cf7e/0xf7565228e460d938 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117296.816652:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: 00000000ceb9cf7e/0xf7565228e460d938 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117296.816673:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053614b5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385419136:0@lo:101: 00000100:00100000:2.0:1789117296.816712:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117296.816759:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd024922 going to sleep for 11 seconds 00000100:00100000:3.0:1789117296.816939:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385419136 00000100:00100000:3.0:1789117296.816959:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385419136 00000100:00100000:3.0:1789117296.816997:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789117296.817004:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fee65b88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+5:5820:x1876025385419136:12345-0@lo:101: 00010000:00010000:3.0:1789117296.817016:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117296.817028:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b7f3d227/0xf7565228e460d93f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460d938 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117296.817047:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b7f3d227/0xf7565228e460d93f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460d938 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117296.817056:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b7f3d227/0xf7565228e460d93f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460d938 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117296.817064:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b7f3d227, rc 0) 00000100:00100000:3.0:1789117296.817097:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fee65b88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+6:5820:x1876025385419136:12345-0@lo:101: Request processed in 94us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117296.817103:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117296.817199:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053614b5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385419136:0@lo:101: 00010000:00010000:2.0:1789117296.817211:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: 00000000ceb9cf7e/0xf7565228e460d938 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d93f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117296.817219:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: 00000000ceb9cf7e/0xf7565228e460d938 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460d93f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117296.817269:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053614b5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385419264:0@lo:501: 00000100:00100000:2.0:1789117296.817291:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117296.817309:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd024922 going to sleep for 11 seconds 00000100:00100000:3.0:1789117296.817360:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385419264 00000100:00100000:3.0:1789117296.817364:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385419264 00000100:00100000:3.0:1789117296.817389:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789117296.817395:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e9b70b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+6:5820:x1876025385419264:12345-0@lo:501: 00000100:00100000:3.0:1789117296.817731:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e9b70b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+6:5820:x1876025385419264:12345-0@lo:501: Request processed in 336us (438us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789117296.817738:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789117296.817979:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053614b5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385419264:0@lo:501: 10000000:01000000:2.0:1789117296.818002:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789117296.818018:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: 00000000ceb9cf7e/0xf7565228e460d938 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d93f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117296.818026:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: 00000000ceb9cf7e/0xf7565228e460d938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d93f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117296.818034:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c178548d000 10000000:01000000:2.0:1789117296.818038:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789117296.818042:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c178548d000 10000000:01000000:2.0:1789117296.818044:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789117296.818046:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c178548d000 from 1 10000000:01000000:2.0:1789117296.818054:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789117296.818071:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: 00000000f6a556a6/0xf7565228e460d946 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117296.818077:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: 00000000f6a556a6/0xf7565228e460d946 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117296.818085:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: 00000000f6a556a6/0xf7565228e460d946 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117296.818095:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053614b5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385419392:0@lo:101: 00000100:00100000:2.0:1789117296.818119:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117296.818145:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd024922 going to sleep for 11 seconds 00000100:00100000:1.0:1789117296.818198:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385419392 00000100:00100000:1.0:1789117296.818203:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385419392 00000100:00100000:1.0:1789117296.818241:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789117296.818247:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f871f8ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+6:5820:x1876025385419392:12345-0@lo:101: 00010000:00010000:1.0:1789117296.818264:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117296.818273:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002f120af6/0xf7565228e460d94d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460d946 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117296.818287:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002f120af6/0xf7565228e460d94d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460d946 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117296.818294:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002f120af6/0xf7565228e460d94d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460d946 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117296.818300:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002f120af6, rc 0) 00000100:00100000:1.0:1789117296.818324:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f871f8ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+7:5820:x1876025385419392:12345-0@lo:101: Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117296.818329:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789117296.818560:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053614b5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385419392:0@lo:101: 00010000:00010000:2.0:1789117296.818579:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: 00000000f6a556a6/0xf7565228e460d946 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d94d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117296.818587:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: 00000000f6a556a6/0xf7565228e460d946 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460d94d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117296.818598:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789117296.818608:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: 00000000f6a556a6/0xf7565228e460d946 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d94d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117296.818614:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: 00000000f6a556a6/0xf7565228e460d946 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d94d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117296.818620:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789117296.818623:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789117296.818626:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c178548d000 10000000:01000000:2.0:1789117296.818633:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789117296.818636:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789117296.818638:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789117296.818650:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: 00000000e5f15293/0xf7565228e460d954 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117296.818656:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: 00000000e5f15293/0xf7565228e460d954 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117296.818662:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: 00000000e5f15293/0xf7565228e460d954 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117296.818671:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053614b5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385419520:0@lo:101: 00000100:00100000:2.0:1789117296.818693:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117296.818711:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd024922 going to sleep for 11 seconds 00000100:00100000:2.0:1789117296.818725:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385419520 00000100:00100000:2.0:1789117296.818728:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385419520 00000100:00100000:2.0:1789117296.818851:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789117296.818858:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a4d5c7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+7:5820:x1876025385419520:12345-0@lo:101: 00010000:00010000:2.0:1789117296.818864:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117296.818871:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d433f5db/0xf7565228e460d95b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460d954 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117296.818883:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d433f5db/0xf7565228e460d95b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460d954 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117296.818890:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d433f5db/0xf7565228e460d95b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460d954 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117296.818896:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d433f5db, rc 0) 00000100:00100000:2.0:1789117296.818928:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a4d5c7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+8:5820:x1876025385419520:12345-0@lo:101: Request processed in 71us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117296.818933:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789117296.819139:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053614b5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385419520:0@lo:101: 00010000:00010000:3.0:1789117296.819149:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: 00000000e5f15293/0xf7565228e460d954 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d95b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117296.819155:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: 00000000e5f15293/0xf7565228e460d954 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460d95b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117296.819204:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cf3da9da pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385419648:0@lo:501: 00000100:00100000:3.0:1789117296.819228:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117296.819666:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 0000000027e02b87 going to sleep for 11 seconds 00000100:00100000:1.0:1789117296.819725:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385419648 00000100:00100000:1.0:1789117296.819730:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385419648 00000100:00100000:1.0:1789117296.819749:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789117296.819754:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4137ae2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+8:5820:x1876025385419648:12345-0@lo:501: 00000100:00100000:1.0:1789117296.819963:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4137ae2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+9:5820:x1876025385419648:12345-0@lo:501: Request processed in 208us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117296.819970:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789117296.820103:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cf3da9da pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385419648:0@lo:501: 00000100:00100000:3.0:1789117296.820129:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cf3da9da pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385419776:0@lo:503: 00000100:00100000:3.0:1789117296.820161:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117296.820179:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 0000000027e02b87 going to sleep for 11 seconds 00000100:00100000:1.0:1789117296.820225:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385419776 00000100:00100000:1.0:1789117296.820228:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385419776 00000100:00100000:1.0:1789117296.820244:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789117296.820248:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062fb8b4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+9:5820:x1876025385419776:12345-0@lo:503: 00000100:00100000:1.0:1789117296.820681:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062fb8b4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+9:5820:x1876025385419776:12345-0@lo:503: Request processed in 432us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117296.820688:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789117296.820881:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cf3da9da pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385419776:0@lo:503: 00000100:00100000:0.0:1789117296.821230:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006f03e5d pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5863:1876025385419904:0@lo:502: 00000100:00100000:1.0:1789117296.821677:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117296.821746:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set 0000000003ee620f going to sleep for 11 seconds 00000100:00100000:0.0:1789117296.821856:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385419904 00000100:00100000:0.0:1789117296.821861:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385419904 00000100:00100000:0.0:1789117296.821940:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789117296.821959:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000572ca60f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+9:5863:x1876025385419904:12345-0@lo:502: 00000100:00100000:0.0:1789117296.822145:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000572ca60f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+9:5863:x1876025385419904:12345-0@lo:502: Request processed in 187us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117296.822152:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789117296.822232:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006f03e5d pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5863:1876025385419904:0@lo:502: 00000020:01000000:1.0:1789117296.822274:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117296.822285:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117296.822287:0:5863:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789117296.822291:0:5863:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789117296.822293:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789117296.822312:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000051889347) 00000020:00000080:1.0:1789117296.822328:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789117296.822334:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789117296.822482:0:5863:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789117296.822489:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7565228e460d969 00000020:00000080:1.0:1789117296.822711:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789117296.822717:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117296.822720:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117296.822721:0:5863:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789117296.822724:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117296.822727:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117296.822728:0:5863:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789117296.822730:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789117296.822735:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000798f4524) 00000020:00000080:1.0:1789117296.822743:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789117296.822745:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789117296.822750:0:5863:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789117296.822753:0:5863:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789117296.822759:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789117296.822811:0:5863:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002d6f8a6c from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789117296.822821:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000002f2973d9) 00000020:00000080:1.0:1789117296.822828:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789117296.822866:0:5863:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789117296.822869:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7565228e460d97e 00000020:00000080:1.0:1789117296.822963:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789117296.822969:0:5863:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789117296.822972:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf7565228e460d985 00080000:01000000:1.0:1789117296.822976:0:5863:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789117296.822978:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7565228e460d98c 00080000:10000000:1.0:1789117296.823310:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1789117296.823530:0:5863:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1789117296.827231:0:5863:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789117296.928771:0:5863:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789117296.929157:0:5863:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789117296.938987:0:5863:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789117296.939251:0:5863:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789117297.020587:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ef521477) 00000020:00000080:3.0:1789117297.020608:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789117297.020672:0:5863:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789117297.020679:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7565228e460d99a 00000020:00000080:0.0:1789117297.021684:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1789117297.024953:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789117297.066351:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789117297.104573:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789117297.156866:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789117297.208279:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789117297.293477:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1789117297.371389:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf7565228e460d9a1 00000020:00000080:0.0:1789117297.373436:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789117297.373448:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117297.373454:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117297.373457:0:5863:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789117297.373459:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117297.373465:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117297.373466:0:5863:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789117297.373470:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789117297.373507:0:5863:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789117297.373522:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117297.373525:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117297.373526:0:5863:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789117297.373528:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117297.373531:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117297.373532:0:5863:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789117297.373534:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789117297.373536:0:5863:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789117297.373574:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021fa46e4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5863:1876025385420032:0@lo:502: 00000100:00100000:0.0:1789117297.373645:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117297.373696:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set 000000007db2941c going to sleep for 11 seconds 00000100:00100000:2.0:1789117297.373764:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385420032 00000100:00100000:2.0:1789117297.373771:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385420032 00000100:00100000:2.0:1789117297.373815:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789117297.373823:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b47c9b8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+9:5863:x1876025385420032:12345-0@lo:502: 00000100:00100000:2.0:1789117297.374478:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b47c9b8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+9:5863:x1876025385420032:12345-0@lo:502: Request processed in 655us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117297.374486:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789117297.374536:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021fa46e4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5863:1876025385420032:0@lo:502: 00000020:01000000:2.0:1789117297.374562:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117297.374567:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117297.374568:0:5863:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789117297.374572:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1789117297.374761:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1789117297.374778:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789117297.374796:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: 00000000e5f15293/0xf7565228e460d954 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d95b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.374805:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: 00000000e5f15293/0xf7565228e460d954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d95b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117297.374823:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c178548d000 from 1 10000000:01000000:3.0:1789117297.374826:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789117297.374850:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: 00000000a3791d61/0xf7565228e460d9a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.374856:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: 00000000a3791d61/0xf7565228e460d9a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.374864:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: 00000000a3791d61/0xf7565228e460d9a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117297.374876:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cf3da9da pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385420160:0@lo:101: 00000100:00100000:3.0:1789117297.374904:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117297.374924:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000556f4cae going to sleep for 11 seconds 00000100:00100000:0.0:1789117297.375008:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385420160 00000100:00100000:0.0:1789117297.375014:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385420160 00000100:00100000:0.0:1789117297.375048:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789117297.375055:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003e526e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+9:5820:x1876025385420160:12345-0@lo:101: 00010000:00010000:0.0:1789117297.375178:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117297.375190:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a152e07d/0xf7565228e460d9af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460d9a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117297.375208:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a152e07d/0xf7565228e460d9af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460d9a8 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117297.375216:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a152e07d/0xf7565228e460d9af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460d9a8 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117297.375324:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a152e07d, rc 0) 00000100:00100000:0.0:1789117297.375358:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003e526e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+10:5820:x1876025385420160:12345-0@lo:101: Request processed in 303us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117297.375364:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789117297.375453:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cf3da9da pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385420160:0@lo:101: 00010000:00010000:3.0:1789117297.375463:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: 00000000a3791d61/0xf7565228e460d9a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d9af expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.375472:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: 00000000a3791d61/0xf7565228e460d9a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460d9af expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117297.376356:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cf3da9da pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385420288:0@lo:256: 00000100:00100000:3.0:1789117297.376393:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117297.376448:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000556f4cae going to sleep for 11 seconds 00000100:00100000:3.0:1789117297.376465:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385420288 00000100:00100000:3.0:1789117297.376469:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385420288 00000100:00100000:3.0:1789117297.376500:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789117297.376506:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8a8670e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+10:5820:x1876025385420288:12345-0@lo:256: 20000000:01000000:3.0:1789117297.376527:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789117297.376532:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789117297.376594:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8a8670e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+10:5820:x1876025385420288:12345-0@lo:256: Request processed in 88us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117297.376601:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789117297.376633:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cf3da9da pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385420288:0@lo:256: 10000000:01000000:3.0:1789117297.379761:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789117297.379783:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: 00000000a3791d61/0xf7565228e460d9a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d9af expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.379795:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: 00000000a3791d61/0xf7565228e460d9a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d9af expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117297.379804:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c178548d000 from 1 10000000:01000000:3.0:1789117297.379806:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789117297.379837:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: 000000006dfd5bdf/0xf7565228e460d9b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.379845:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: 000000006dfd5bdf/0xf7565228e460d9b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.379853:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: 000000006dfd5bdf/0xf7565228e460d9b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117297.379872:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cf3da9da pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385420416:0@lo:101: 00000100:00100000:3.0:1789117297.379925:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117297.379987:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000556f4cae going to sleep for 11 seconds 00000100:00100000:1.0:1789117297.380117:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385420416 00000100:00100000:1.0:1789117297.380124:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385420416 00000100:00100000:1.0:1789117297.380164:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789117297.380170:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4ed2db4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+10:5820:x1876025385420416:12345-0@lo:101: 00010000:00010000:1.0:1789117297.380181:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117297.380192:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fd11b1fb/0xf7565228e460d9bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460d9b6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117297.380210:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fd11b1fb/0xf7565228e460d9bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460d9b6 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117297.380218:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fd11b1fb/0xf7565228e460d9bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460d9b6 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117297.380225:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fd11b1fb, rc 0) 00000100:00100000:1.0:1789117297.380384:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4ed2db4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:5820:x1876025385420416:12345-0@lo:101: Request processed in 213us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117297.380391:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789117297.380449:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cf3da9da pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385420416:0@lo:101: 00010000:00010000:1.0:1789117297.380565:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: 000000006dfd5bdf/0xf7565228e460d9b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d9bd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117297.380574:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: 000000006dfd5bdf/0xf7565228e460d9b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460d9bd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117297.380628:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb4d2676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385420544:0@lo:501: 00000100:00100000:1.0:1789117297.380852:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117297.380879:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 000000006fd2fea3 going to sleep for 11 seconds 00000100:00100000:3.0:1789117297.381765:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385420544 00000100:00100000:3.0:1789117297.381775:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385420544 00000100:00100000:3.0:1789117297.381833:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789117297.381842:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d28b1501 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:5820:x1876025385420544:12345-0@lo:501: 00000100:00100000:3.0:1789117297.382396:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d28b1501 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:5820:x1876025385420544:12345-0@lo:501: Request processed in 555us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117297.382429:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789117297.382966:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb4d2676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385420544:0@lo:501: 00000100:00100000:1.0:1789117297.383015:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb4d2676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385420672:0@lo:503: 00000100:00100000:1.0:1789117297.383057:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117297.383093:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 000000006fd2fea3 going to sleep for 11 seconds 00000100:00100000:3.0:1789117297.383217:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385420672 00000100:00100000:3.0:1789117297.383233:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385420672 00000100:00100000:3.0:1789117297.383383:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789117297.383391:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ee8e2ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:5820:x1876025385420672:12345-0@lo:503: 00000040:00080000:3.0:1789117297.383462:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789117297.383500:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ee8e2ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:5820:x1876025385420672:12345-0@lo:503: Request processed in 111us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117297.383507:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789117297.383650:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb4d2676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385420672:0@lo:503: 00000040:00080000:1.0:1789117297.384321:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789117297.384427:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789117297.384441:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789117297.384452:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: 000000006dfd5bdf/0xf7565228e460d9b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d9bd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117297.384461:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: 000000006dfd5bdf/0xf7565228e460d9b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d9bd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117297.384509:0:5820:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789117297.384512:0:5820:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c178548d000 10000000:01000000:1.0:1789117297.384514:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c178548d000 10000000:01000000:1.0:1789117297.384518:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789117297.384523:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c178548d000 from 1 10000000:01000000:1.0:1789117297.384526:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789117297.384552:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: 00000000a7735d21/0xf7565228e460d9c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117297.384559:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: 00000000a7735d21/0xf7565228e460d9c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117297.384567:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: 00000000a7735d21/0xf7565228e460d9c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117297.384580:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb4d2676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385420800:0@lo:101: 00000100:00100000:1.0:1789117297.384614:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117297.389840:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385420800 00000100:00100000:2.0:1789117297.389852:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385420800 00000100:00100000:1.0:1789117297.389996:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 0000000010f8da01 going to sleep for 11 seconds 00000100:00100000:3.0:1789117297.391611:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789117297.391624:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000def268ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:5820:x1876025385420800:12345-0@lo:101: 00010000:00010000:3.0:1789117297.391640:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117297.391671:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004b89382a/0xf7565228e460d9cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460d9c4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.391699:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004b89382a/0xf7565228e460d9cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460d9c4 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.391709:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004b89382a/0xf7565228e460d9cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460d9c4 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.391718:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004b89382a, rc 0) 00000100:00100000:3.0:1789117297.391791:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000def268ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:5820:x1876025385420800:12345-0@lo:101: Request processed in 172us (7177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117297.391810:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789117297.392048:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb4d2676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385420800:0@lo:101: 00010000:00010000:1.0:1789117297.392065:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: 00000000a7735d21/0xf7565228e460d9c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d9cb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117297.392073:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: 00000000a7735d21/0xf7565228e460d9c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460d9cb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117297.392134:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb4d2676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385420928:0@lo:501: 00000100:00100000:1.0:1789117297.392166:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117297.393861:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385420928 00000100:00100000:2.0:1789117297.393872:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385420928 00000100:00100000:2.0:1789117297.393912:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789117297.393920:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017f28de3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:5820:x1876025385420928:12345-0@lo:501: 00000100:00100000:1.0:1789117297.394001:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 0000000010f8da01 going to sleep for 11 seconds 00000100:00100000:2.0:1789117297.394276:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017f28de3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:5820:x1876025385420928:12345-0@lo:501: Request processed in 357us (2110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117297.394284:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789117297.394788:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb4d2676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385420928:0@lo:501: 00000100:00100000:1.0:1789117297.394831:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb4d2676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385421056:0@lo:503: 00000100:00100000:1.0:1789117297.394880:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117297.395113:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 0000000010f8da01 going to sleep for 11 seconds 00000100:00100000:2.0:1789117297.397021:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385421056 00000100:00100000:2.0:1789117297.397034:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385421056 00000100:00100000:2.0:1789117297.397087:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789117297.397105:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034ccc83e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:5820:x1876025385421056:12345-0@lo:503: 00000100:00100000:2.0:1789117297.397993:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034ccc83e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:5820:x1876025385421056:12345-0@lo:503: Request processed in 888us (3110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117297.398002:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789117297.402970:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb4d2676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385421056:0@lo:503: 00000100:00100000:0.0:1789117297.409168:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034c02885 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5868:1876025385421184:0@lo:502: 00000100:00100000:0.0:1789117297.409441:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117297.409488:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b9e96b9 going to sleep for 11 seconds 00000100:00100000:2.0:1789117297.409644:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385421184 00000100:00100000:2.0:1789117297.410160:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385421184 00000100:00100000:2.0:1789117297.410215:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789117297.410223:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b40bbba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:5868:x1876025385421184:12345-0@lo:502: 00000100:00100000:2.0:1789117297.410862:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b40bbba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:5868:x1876025385421184:12345-0@lo:502: Request processed in 639us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117297.410871:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789117297.411109:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034c02885 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5868:1876025385421184:0@lo:502: 00000020:01000004:0.0:1789117297.411191:0:5868:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789117297.411216:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000002aaa595b) 00000020:00000080:0.0:1789117297.411517:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789117297.411591:0:5868:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002d6f8a6c from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789117297.411595:0:5868:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002d6f8a6c from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789117297.411598:0:5868:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002d6f8a6c 4 00010000:00080000:0.0:1789117297.411624:0:5868:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005f5f2c97@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.137@tcp at head 00010000:00010000:2.0:1789117297.414820:0:5868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789117297.416362:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789117297.416431:0:5868:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789117297.416444:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf7565228e460d9d9 00000100:00080000:2.0:1789117297.416454:0:5868:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789117297.416469:0:5868:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005f5f2c97 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:2.0:1789117297.416501:0:5868:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000625ad121 x1876025385421312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789117297.417698:0:5868:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789117297.418267:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000625ad121 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876025385421312:0@lo:38: 00000100:00100000:0.0:1789117297.418338:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117297.418593:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb4d2676 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5868:1876025385421440:0@lo:502: 00000100:00100000:2.0:1789117297.418603:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385421312 00000100:00100000:2.0:1789117297.418669:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385421312 00000100:00100000:2.0:1789117297.418711:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789117297.418718:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034c02885 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876025385421312:12345-0@lo:38: 00000100:00100000:2.0:1789117297.418771:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034c02885 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876025385421312:12345-0@lo:38: Request processed in 53us (433us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789117297.418777:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789117297.418812:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789117297.418825:0:3297:0:(import.c:65:import_set_state_nolock()) 000000005f5f2c97 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789117297.418829:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789117297.418832:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000625ad121 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876025385421312:0@lo:38: 00000100:00100000:1.0:1789117297.419554:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117297.419584:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385421440 00000100:00100000:1.0:1789117297.419589:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385421440 00000100:00100000:1.0:1789117297.419619:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789117297.419626:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000475d8873 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:5868:x1876025385421440:12345-0@lo:502: 00000100:00100000:1.0:1789117297.419816:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000475d8873 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:5868:x1876025385421440:12345-0@lo:502: Request processed in 190us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117297.419823:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789117297.419918:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set 000000006fd2fea3 going to sleep for 11 seconds 00000100:00100000:1.0:1789117297.419934:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb4d2676 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5868:1876025385421440:0@lo:502: 00000040:00080000:1.0:1789117297.419971:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789117297.420214:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789117297.420248:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789117297.420271:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: 00000000a7735d21/0xf7565228e460d9c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d9cb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117297.420281:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: 00000000a7735d21/0xf7565228e460d9c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d9cb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789117297.420322:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789117297.420325:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789117297.420326:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117297.420327:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117297.420328:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117297.420330:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117297.420331:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789117297.420332:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789117297.420333:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789117297.420335:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789117297.420336:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117297.420338:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789117297.420340:0:5820:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789117297.420342:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789117297.420344:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789117297.420345:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117297.420346:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117297.420347:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117297.420348:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117297.420349:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789117297.420350:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789117297.420351:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789117297.420352:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789117297.420353:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117297.420353:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789117297.420368:0:5820:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789117297.420378:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021fa46e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385421568:0@lo:253: 00000100:00100000:0.0:1789117297.420442:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117297.420467:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b9e96b9 going to sleep for 11 seconds 00000100:00100000:2.0:1789117297.420670:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385421568 00000100:00100000:2.0:1789117297.420676:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385421568 00000100:00100000:2.0:1789117297.420742:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789117297.420750:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000617702 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:5820:x1876025385421568:12345-0@lo:253: 20000000:01000000:2.0:1789117297.420769:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789117297.420781:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1789117297.478609:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1789117297.543722:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789117297.543741:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789117297.545020:0:5855:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789117297.545028:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789117297.545049:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006d7a3239/0xf7565228e460d9e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.545068:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a152e07d/0xf7565228e460d9af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460d9a8 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.545075:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006d7a3239/0xf7565228e460d9e0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.545122:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a152e07d/0xf7565228e460d9af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460d9a8 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.545135:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a152e07d/0xf7565228e460d9af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460d9a8 expref: 12 pid: 5834 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117297.545149:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c64d8705 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1876025385421696:0@lo:104: 00000100:00100000:3.0:1789117297.545205:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117297.545277:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set 000000007384c2e7 going to sleep for 11 seconds 00000100:00100000:1.0:1789117297.545952:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385421696 00000100:00100000:1.0:1789117297.545960:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385421696 00000100:00100000:1.0:1789117297.546015:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789117297.546024:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a35bfd7a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:5855:x1876025385421696:12345-0@lo:104: 00010000:00010000:1.0:1789117297.546038:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: 00000000a3791d61/0xf7565228e460d9a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460d9af expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117297.546111:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789117297.546116:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a35bfd7a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:5855:x1876025385421696:12345-0@lo:104: Request processed in 94us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117297.546138:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789117297.546732:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117297.546739:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: 00000000a3791d61/0xf7565228e460d9a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460d9af expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.546747:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a3791d61 already unused, calling callback (00000000b84ead0b) 10000000:00010000:3.0:1789117297.546750:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: 00000000a3791d61/0xf7565228e460d9a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460d9af expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.546757:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: 00000000a3791d61/0xf7565228e460d9a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460d9af expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117297.546771:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: 00000000a3791d61/0xf7565228e460d9a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460d9af expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117297.546776:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789117297.546813:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: 00000000a3791d61/0xf7565228e460d9a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460d9af expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.546820:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117297.546843:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: 00000000a3791d61/0xf7565228e460d9a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460d9af expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.546848:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: 00000000a3791d61/0xf7565228e460d9a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460d9af expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.546863:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117297.546864:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117297.546866:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117297.546911:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117297.546921:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075e85c74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385421824:0@lo:103: 00000100:00100000:3.0:1789117297.546967:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117297.547019:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385421824 00000100:00100000:3.0:1789117297.547025:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385421824 00010000:00010000:3.0:1789117297.547041:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a152e07d/0xf7565228e460d9af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460d9a8 expref: 13 pid: 5834 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117297.547064:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789117297.547070:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000679c47a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:3298:x1876025385421824:12345-0@lo:103: 00010000:00010000:3.0:1789117297.547523:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117297.547528:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a152e07d/0xf7565228e460d9af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460d9a8 expref: 13 pid: 5834 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.547544:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a152e07d/0xf7565228e460d9af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460d9a8 expref: 13 pid: 5834 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.547559:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006d7a3239/0xf7565228e460d9e0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.547566:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006d7a3239/0xf7565228e460d9e0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789117297.547579:0:5825:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002551426s 00010000:00010000:3.0:1789117297.547582:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006d7a3239/0xf7565228e460d9e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.547588:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006d7a3239/0xf7565228e460d9e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.547594:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006d7a3239/0xf7565228e460d9e0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.547599:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006d7a3239/0xf7565228e460d9e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.547604:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006d7a3239 already unused, calling callback (0000000035f530b4) 00010000:00010000:3.0:1789117297.547606:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006d7a3239/0xf7565228e460d9e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.547613:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006d7a3239/0xf7565228e460d9e0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.547620:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006d7a3239/0xf7565228e460d9e0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.547640:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117297.547679:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000679c47a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:3298:x1876025385421824:12345-0@lo:103: Request processed in 609us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117297.547686:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789117297.547726:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a152e07d/0xf7565228e460d9af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460d9a8 expref: 12 pid: 5834 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117297.547737:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c64d8705 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1876025385421696:0@lo:104: 00010000:00010000:3.0:1789117297.547753:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006d7a3239/0xf7565228e460d9e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.547761:0:5855:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006d7a3239/0xf7565228e460d9e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.547765:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006d7a3239/0xf7565228e460d9e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117297.547771:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006d7a3239/0xf7565228e460d9e0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117297.547880:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075e85c74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385421824:0@lo:103: 00000100:00100000:2.0:1789117297.554971:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000617702 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:5820:x1876025385421568:12345-0@lo:253: Request processed in 134214us (134521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117297.554995:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789117297.555119:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021fa46e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5820:1876025385421568:0@lo:253: 10000000:01000000:0.0:1789117297.555136:0:5820:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789117297.555139:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789117297.555141:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789117297.555143:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117297.555144:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117297.555145:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117297.555146:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117297.555147:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789117297.555148:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789117297.555150:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789117297.555151:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789117297.555152:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117297.555154:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789117297.555170:0:5820:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789117297.562524:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789117297.562908:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789117297.563126:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789117297.563318:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789117297.564623:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1789117297.564841:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789117297.582068:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789117297.582279:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789117297.582628:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789117297.582789:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789117297.582969:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789117297.583144:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1789117297.746423:0:5820:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1789117297.866974:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789117297.867566:0:5874:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1789117297.878791:0:5873:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789117297.878798:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789117297.888260:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789117297.888628:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789117297.893839:0:5820:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789117297.893860:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789117297.894566:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789117297.905624:0:5820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789117297.906800:0:5820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789117297.906850:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789117297.907119:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789117297.907325:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1789117297.919821:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789117297.919963:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789117297.920087:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789117297.920219:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789117297.920343:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789117297.920489:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789117297.920600:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789117297.920723:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789117297.920847:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789117297.920995:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789117297.921121:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789117297.921247:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789117297.921376:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789117297.921547:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789117297.921677:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789117297.938217:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789117297.938802:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789117297.938954:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789117297.939123:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789117297.943900:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789117297.944105:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789117297.944284:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789117297.945206:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789117297.951027:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789117297.951270:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789117297.951441:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789117297.951587:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789117297.952217:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789117297.952554:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789117297.952872:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789117297.953046:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789117297.953191:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789117297.954636:0:5820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1789117297.957961:0:5874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1789117298.122181:0:5820:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789117298.122216:0:5820:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc6b01983988 00100000:10000000:0.0:1789117298.122223:0:5820:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789117298.141483:0:5820:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789117298.141499:0:5820:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.137@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789117298.141510:0:5820:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789117298.141532:0:5820:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1789117298.195968:0:5874:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789117298.196040:0:5874:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:3.0:1789117298.196045:0:5874:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1789117298.501657:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117299.536741:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117300.549911:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117301.573630:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117302.597553:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789117302.857454:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789117302.857463:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789117302.857465:0:36:0:(import.c:65:import_set_state_nolock()) 000000005f5f2c97 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789117302.857476:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005f5f2c97 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:3.0:1789117302.857503:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000449f6db9 x1876025385422080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789117302.857541:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000449f6db9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876025385422080:0@lo:38: 00000100:00100000:3.0:1789117302.857604:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117302.857779:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cf3da9da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385421952:0@lo:400: 00000100:00100000:0.0:1789117302.857812:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117302.857887:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385422080 00000100:00100000:0.0:1789117302.857894:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385422080 00000100:00100000:0.0:1789117302.857934:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789117302.857940:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e702e70 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1876025385422080:12345-0@lo:38: 00010000:00080000:0.0:1789117302.857962:0:5841:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 149 last 0 00000020:00000080:0.0:1789117302.857993:0:5841:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf7565228e460d9e7 00000004:00100000:0.0:1789117302.858032:0:5841:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789117302.858142:0:5841:0:(import.c:65:import_set_state_nolock()) 0000000021566992 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789117302.858190:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e702e70 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1876025385422080:12345-0@lo:38: Request processed in 249us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117302.858198:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789117302.858473:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385421952 00000100:00100000:3.0:1789117302.858478:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385421952 00000100:00100000:3.0:1789117302.858515:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789117302.858522:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fcf86fae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:3300:x1876025385421952:12345-0@lo:400: 00000100:00100000:3.0:1789117302.858563:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fcf86fae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:3300:x1876025385421952:12345-0@lo:400: Request processed in 42us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117302.858569:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789117302.858610:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cf3da9da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385421952:0@lo:400: 00010000:00080000:3.0:1789117302.858637:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000449f6db9 x1876025385422080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789117312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789117302.858651:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789117302.858658:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789117302.858662:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789117302.858664:0:3297:0:(import.c:65:import_set_state_nolock()) 000000005f5f2c97 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789117302.858669:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000449f6db9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876025385422080:0@lo:38: 00000001:02000400:2.0:1789117303.170358:0:6117:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg637-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789117303.628469:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117304.665971:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117305.669623:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789117306.439680:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789117306.439688:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c178548d000 from 3 10000000:01000000:1.0:1789117306.439692:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789117306.439732:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: 00000000fcf3ba90/0xf7565228e460d9ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117306.439744:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: 00000000fcf3ba90/0xf7565228e460d9ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117306.439754:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: 00000000fcf3ba90/0xf7565228e460d9ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117306.439775:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000053af2b5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385422208:0@lo:101: 00000100:00100000:1.0:1789117306.439837:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117306.439915:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 000000001299c70e going to sleep for 11 seconds 00000100:00100000:3.0:1789117306.439973:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385422208 00000100:00100000:3.0:1789117306.439981:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385422208 00000100:00100000:3.0:1789117306.440027:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789117306.440034:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e6c162c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:5837:x1876025385422208:12345-0@lo:101: 00010000:00010000:3.0:1789117306.440045:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117306.440058:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a3791d61/0xf7565228e460d9f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460d9ee expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117306.440084:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a3791d61/0xf7565228e460d9f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460d9ee expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117306.440093:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a3791d61/0xf7565228e460d9f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460d9ee expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117306.440101:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a3791d61, rc 0) 00000100:00100000:3.0:1789117306.440149:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e6c162c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:5837:x1876025385422208:12345-0@lo:101: Request processed in 116us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117306.440156:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789117306.440229:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000053af2b5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385422208:0@lo:101: 00010000:00010000:0.0:1789117306.440243:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: 00000000fcf3ba90/0xf7565228e460d9ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d9f5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117306.440251:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: 00000000fcf3ba90/0xf7565228e460d9ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460d9f5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117306.440301:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021fa46e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385422336:0@lo:256: 00000100:00100000:0.0:1789117306.440332:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117306.440353:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 000000004520a375 going to sleep for 11 seconds 00000100:00100000:3.0:1789117306.440394:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385422336 00000100:00100000:3.0:1789117306.440424:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385422336 00000100:00100000:3.0:1789117306.440451:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789117306.440457:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9cb373c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:5837:x1876025385422336:12345-0@lo:256: 20000000:01000000:3.0:1789117306.440469:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789117306.440483:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789117306.440487:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789117306.440553:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9cb373c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:5837:x1876025385422336:12345-0@lo:256: Request processed in 96us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117306.440561:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789117306.440630:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021fa46e4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385422336:0@lo:256: 10000000:01000000:0.0:1789117306.440670:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789117306.440676:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: 00000000fcf3ba90/0xf7565228e460d9ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d9f5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117306.440683:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: 00000000fcf3ba90/0xf7565228e460d9ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d9f5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117306.693681:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789117307.554877:0:6319:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec6b58a20 20000000:00000080:2.0:1789117307.554903:0:6319:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c17c1c7b400 uarg=0000000000000000 20000000:01000000:2.0:1789117307.554935:0:6319:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789117307.554941:0:6319:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789117307.554945:0:6319:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789117307.555164:0:6319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789117307.555175:0:6319:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789117307.559356:0:6319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789117307.559739:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789117307.559797:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789117307.559849:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789117307.559866:0:6319:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789117307.559883:0:6319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002474479d/0xf7565228e460d9fc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117307.559911:0:6319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fd11b1fb/0xf7565228e460d9bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460d9b6 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117307.559918:0:6319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002474479d/0xf7565228e460d9fc lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117307.559954:0:6319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fd11b1fb/0xf7565228e460d9bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460d9b6 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117307.559971:0:6319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fd11b1fb/0xf7565228e460d9bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460d9b6 expref: 11 pid: 5835 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117307.559986:0:6319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000da4b72f4 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6319:1876025385422464:0@lo:104: 00000100:00100000:2.0:1789117307.560159:0:6319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117307.560287:0:6319:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5ef1916 going to sleep for 11 seconds 00000100:00100000:1.0:1789117307.563184:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385422464 00000100:00100000:1.0:1789117307.563198:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385422464 00000100:00100000:1.0:1789117307.563266:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789117307.563275:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b646f2bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:6319:x1876025385422464:12345-0@lo:104: 00010000:00010000:1.0:1789117307.563291:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: 000000006dfd5bdf/0xf7565228e460d9b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460d9bd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117307.563440:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789117307.563445:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b646f2bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:6319:x1876025385422464:12345-0@lo:104: Request processed in 173us (3287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117307.563453:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789117307.563573:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117307.563579:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: 000000006dfd5bdf/0xf7565228e460d9b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460d9bd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117307.563586:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006dfd5bdf already unused, calling callback (00000000b84ead0b) 10000000:00010000:3.0:1789117307.563590:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: 000000006dfd5bdf/0xf7565228e460d9b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460d9bd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117307.563611:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: 000000006dfd5bdf/0xf7565228e460d9b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460d9bd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117307.563617:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: 000000006dfd5bdf/0xf7565228e460d9b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460d9bd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117307.563622:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789117307.563659:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: 000000006dfd5bdf/0xf7565228e460d9b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460d9bd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117307.563666:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117307.563682:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: 000000006dfd5bdf/0xf7565228e460d9b6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460d9bd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117307.563687:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: 000000006dfd5bdf/0xf7565228e460d9b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460d9bd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117307.563702:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117307.563704:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117307.563706:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117307.563726:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117307.563737:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000068e61b1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385422592:0@lo:103: 00000100:00100000:3.0:1789117307.563773:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117307.563815:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385422592 00000100:00100000:3.0:1789117307.563820:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385422592 00010000:00010000:3.0:1789117307.563839:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fd11b1fb/0xf7565228e460d9bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460d9b6 expref: 12 pid: 5835 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117307.563860:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789117307.563866:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079ead4e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:3300:x1876025385422592:12345-0@lo:103: 00010000:00010000:3.0:1789117307.563884:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117307.563900:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fd11b1fb/0xf7565228e460d9bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460d9b6 expref: 12 pid: 5835 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117307.563910:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fd11b1fb/0xf7565228e460d9bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460d9b6 expref: 12 pid: 5835 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117307.563926:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002474479d/0xf7565228e460d9fc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117307.563932:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002474479d/0xf7565228e460d9fc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117307.563945:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002474479d/0xf7565228e460d9fc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117307.563951:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002474479d/0xf7565228e460d9fc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117307.563956:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002474479d/0xf7565228e460d9fc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117307.563961:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002474479d/0xf7565228e460d9fc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117307.563966:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002474479d already unused, calling callback (0000000035f530b4) 00010000:00010000:3.0:1789117307.563969:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002474479d/0xf7565228e460d9fc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117307.563976:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002474479d/0xf7565228e460d9fc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117307.563994:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002474479d/0xf7565228e460d9fc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117307.564016:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117307.564047:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079ead4e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:3300:x1876025385422592:12345-0@lo:103: Request processed in 182us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117307.564055:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789117307.564090:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000068e61b1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385422592:0@lo:103: 00010000:00010000:2.0:1789117307.564967:0:6319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fd11b1fb/0xf7565228e460d9bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460d9b6 expref: 11 pid: 5835 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117307.564980:0:6319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000da4b72f4 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6319:1876025385422464:0@lo:104: 00010000:00010000:2.0:1789117307.564999:0:6319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002474479d/0xf7565228e460d9fc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117307.565072:0:6319:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002474479d/0xf7565228e460d9fc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117307.565081:0:6319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002474479d/0xf7565228e460d9fc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117307.565086:0:6319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002474479d/0xf7565228e460d9fc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117307.718583:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117307.977114:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f78bd8ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876025385422848:0@lo:400: 00000100:00100000:1.0:1789117307.977184:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117307.977264:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117307.977269:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000da4b72f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385422720:0@lo:400: 00000100:00100000:1.0:1789117307.977298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117307.977335:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385422720 00000100:00100000:1.0:1789117307.977341:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385422720 00000100:00100000:1.0:1789117307.977614:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789117307.977624:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000dbbb745 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:3299:x1876025385422720:12345-0@lo:400: 00000100:00100000:1.0:1789117307.977688:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000dbbb745 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:3299:x1876025385422720:12345-0@lo:400: Request processed in 67us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117307.977696:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789117307.977737:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000da4b72f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385422720:0@lo:400: 00000100:00100000:2.0:1789117307.978770:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385422848 00000100:00100000:2.0:1789117307.978780:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385422848 00000100:00100000:2.0:1789117307.978828:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789117307.978835:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5009635 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876025385422848:12345-0@lo:400: 00000100:00100000:2.0:1789117307.978899:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5009635 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876025385422848:12345-0@lo:400: Request processed in 64us (1715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117307.978905:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789117307.979800:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f78bd8ba x1876025385422848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117307.979834:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f78bd8ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876025385422848:0@lo:400: 00010000:00010000:0.0:1789117308.748948:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117309.766035:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117310.794082:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117311.816365:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789117312.069512:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789117312.069519:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c178548d000 from 1 10000000:01000000:1.0:1789117312.069524:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789117312.069568:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: 000000004d1ea30f/0xf7565228e460da03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117312.069580:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: 000000004d1ea30f/0xf7565228e460da03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117312.069590:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: 000000004d1ea30f/0xf7565228e460da03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117312.069612:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f334ad55 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385422976:0@lo:101: 00000100:00100000:1.0:1789117312.069679:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117312.069826:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000be53476e going to sleep for 11 seconds 00000100:00100000:3.0:1789117312.071072:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385422976 00000100:00100000:3.0:1789117312.071083:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385422976 00000100:00100000:0.0:1789117312.071240:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789117312.071250:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000239e0f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:5837:x1876025385422976:12345-0@lo:101: 00010000:00010000:0.0:1789117312.071266:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117312.071292:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000050ab16ed/0xf7565228e460da0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460da03 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117312.071316:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000050ab16ed/0xf7565228e460da0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460da03 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117312.071326:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000050ab16ed/0xf7565228e460da0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460da03 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117312.071334:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000050ab16ed, rc 0) 00000100:00100000:0.0:1789117312.071417:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000239e0f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:5837:x1876025385422976:12345-0@lo:101: Request processed in 151us (1720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117312.071436:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789117312.071597:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f334ad55 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385422976:0@lo:101: 00010000:00010000:2.0:1789117312.071614:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: 000000004d1ea30f/0xf7565228e460da03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460da0a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117312.071623:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: 000000004d1ea30f/0xf7565228e460da03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460da0a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117312.071690:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009e66ad51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385423104:0@lo:501: 00000100:00100000:2.0:1789117312.071721:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117312.071752:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c36201c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117312.071805:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385423104 00000100:00100000:0.0:1789117312.071810:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385423104 00000100:00100000:0.0:1789117312.071838:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789117312.071844:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a52079e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:5837:x1876025385423104:12345-0@lo:501: 00000100:00100000:0.0:1789117312.072522:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a52079e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:5837:x1876025385423104:12345-0@lo:501: Request processed in 675us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117312.072530:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789117312.073320:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009e66ad51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385423104:0@lo:501: 00000100:00100000:2.0:1789117312.073358:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009e66ad51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385423232:0@lo:503: 00000100:00100000:2.0:1789117312.073463:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117312.073526:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c36201c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117312.073561:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385423232 00000100:00100000:0.0:1789117312.073566:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385423232 00000100:00100000:0.0:1789117312.073642:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789117312.073650:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031b36033 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:5837:x1876025385423232:12345-0@lo:503: 00000100:00100000:0.0:1789117312.073880:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031b36033 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:5837:x1876025385423232:12345-0@lo:503: Request processed in 231us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117312.073887:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789117312.073960:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009e66ad51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385423232:0@lo:503: 00000100:00100000:2.0:1789117312.074337:0:6601:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009e66ad51 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6601:1876025385423360:0@lo:502: 00000100:00100000:2.0:1789117312.074370:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117312.074633:0:6601:0:(client.c:2715:ptlrpc_set_wait()) set 000000004a2135e6 going to sleep for 11 seconds 00000100:00100000:1.0:1789117312.074891:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385423360 00000100:00100000:1.0:1789117312.074897:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385423360 00000100:00100000:1.0:1789117312.074993:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789117312.075001:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f1ea395 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:6601:x1876025385423360:12345-0@lo:502: 00000100:00100000:1.0:1789117312.075396:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f1ea395 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:6601:x1876025385423360:12345-0@lo:502: Request processed in 395us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117312.075435:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789117312.075530:0:6601:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009e66ad51 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6601:1876025385423360:0@lo:502: 00000020:01000000:2.0:1789117312.075557:0:6601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117312.075566:0:6601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117312.075568:0:6601:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789117312.075575:0:6601:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c178548d000 00000020:00000080:2.0:1789117312.075578:0:6601:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789117312.075621:0:6601:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788840780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6601:1876025385423488:0@lo:502: 00000100:00100000:2.0:1789117312.075657:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117312.075677:0:6601:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1789485480 going to sleep for 11 seconds 00000100:00100000:0.0:1789117312.075737:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385423488 00000100:00100000:0.0:1789117312.075741:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385423488 00000100:00100000:0.0:1789117312.075771:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789117312.075779:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:6601:x1876025385423488:12345-0@lo:502: 00000100:00100000:0.0:1789117312.076576:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:6601:x1876025385423488:12345-0@lo:502: Request processed in 795us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117312.076584:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789117312.076649:0:6601:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788840780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6601:1876025385423488:0@lo:502: 00000020:01000000:2.0:1789117312.076672:0:6601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117312.076677:0:6601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117312.076679:0:6601:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789117312.076690:0:6601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789117312.077345:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789117312.077363:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117312.077371:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460da03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460da0a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117312.077382:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460da03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460da0a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117312.838428:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117313.094836:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385423744:0@lo:400: 00000100:00100000:0.0:1789117313.094908:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117313.094966:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789117313.094973:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385423616:0@lo:400: 00000100:00100000:0.0:1789117313.095012:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117313.095044:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385423744 00000100:00100000:0.0:1789117313.095050:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385423744 00000100:00100000:0.0:1789117313.095091:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789117313.095099:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385423744:12345-0@lo:400: 00000100:00100000:0.0:1789117313.095158:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385423744:12345-0@lo:400: Request processed in 59us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117313.095166:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789117313.095217:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c179305ed00 x1876025385423744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117313.095232:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385423744:0@lo:400: 00000100:00100000:0.0:1789117313.095377:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385423616 00000100:00100000:0.0:1789117313.095382:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385423616 00000100:00100000:0.0:1789117313.095429:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789117313.095438:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:3301:x1876025385423616:12345-0@lo:400: 00000100:00100000:0.0:1789117313.095489:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:3301:x1876025385423616:12345-0@lo:400: Request processed in 53us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117313.095495:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789117313.097074:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385423616:0@lo:400: 00000020:01000004:1.0:1789117313.633131:0:6682:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789117313.633135:0:6682:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789117313.633562:0:6682:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c17c03a3800 00000020:01000004:1.0:1789117313.633577:0:6682:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789117313.633588:0:6682:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789117313.633599:0:6682:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c17882db490) 00000020:00000080:1.0:1789117313.633616:0:6682:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789117313.646094:0:6682:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789117313.646450:0:6682:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789117313.663301:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789117313.667330:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789117313.667364:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789117313.667464:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789117313.667490:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789117313.667789:0:6682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789117313.667798:0:6682:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789117313.667807:0:6682:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf7565228e460da18 00000020:01000004:3.0:1789117313.667814:0:6682:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789117313.667832:0:6682:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.137@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789117313.667835:0:6682:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789117313.667840:0:6682:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789117313.667843:0:6682:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789117313.667864:0:6682:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c17c1c61a48) 00000020:00000080:3.0:1789117313.667875:0:6682:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1789117313.670278:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789117313.670478:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789117313.670485:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789117313.675817:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789117313.675828:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789117313.676111:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789117313.676117:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789117313.677732:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789117313.677908:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789117313.677913:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789117313.678733:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789117313.678742:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789117313.696661:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789117313.696921:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789117313.696927:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789117313.699500:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789117313.699516:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789117313.701060:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789117313.701072:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789117313.703980:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789117313.704181:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789117313.704188:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789117313.704948:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789117313.704955:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789117313.760685:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789117313.760894:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789117313.760901:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789117313.763040:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789117313.763053:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789117313.771394:0:6682:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789117313.771457:0:6682:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1789117313.771464:0:6682:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.137@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789117313.843080:0:6682:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.137@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789117313.843124:0:6682:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.137@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789117313.843130:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789117313.843131:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789117313.843132:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117313.843134:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117313.843135:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117313.843136:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117313.843138:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789117313.843139:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789117313.843141:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789117313.843142:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117313.843143:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789117313.843146:0:6682:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789117313.843149:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789117313.843150:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789117313.843156:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117313.843157:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117313.843158:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117313.843159:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117313.843160:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789117313.843161:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789117313.843162:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789117313.843163:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117313.843164:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789117313.843188:0:6682:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789117313.844859:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385423872:0@lo:253: 00000100:00100000:0.0:1789117313.844969:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117313.845098:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1784fb9000 going to sleep for 11 seconds 00000100:00100000:1.0:1789117313.846012:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385423872 00000100:00100000:1.0:1789117313.846022:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385423872 00000100:00100000:1.0:1789117313.846145:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789117313.846156:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:6682:x1876025385423872:12345-0@lo:253: 20000000:01000000:1.0:1789117313.846188:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789117313.846191:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789117313.846197:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789117313.846200:0:5835:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1789117313.847816:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789117313.848098:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1789117313.848117:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1789117313.848162:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1789117313.848171:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1789117313.848202:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1789117313.848253:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1789117313.848648:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1789117313.848666:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.137@tcp 20000000:01000000:2.0:1789117313.848668:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.137@tcp (null) (null) (null) 00000040:00080000:2.0:1789117313.848715:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1789117313.848723:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789117313.848828:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789117313.848861:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.137@tcp (null) (null) 00000040:00080000:3.0:1789117313.848910:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789117313.848922:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789117313.848954:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789117313.849017:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1789117313.849820:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789117313.849835:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.137@tcp 20000000:01000000:3.0:1789117313.849836:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.137@tcp (null) (null) (null) 00000040:00080000:3.0:1789117313.849879:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789117313.849888:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789117313.849920:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789117313.849928:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.137@tcp (null) (null) 00000040:00080000:3.0:1789117313.849994:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789117313.850004:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789117313.850038:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1789117313.850071:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1789117313.850085:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1789117313.850088:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1789117313.850093:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789117313.850094:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789117313.850096:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789117313.850106:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789117313.850109:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789117313.850136:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789117313.850138:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789117313.850756:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789117313.850992:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1789117313.851025:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1789117313.851088:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1789117313.851105:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789117313.851107:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789117313.851579:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789117313.851621:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789117313.851671:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789117313.851947:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1789117313.851979:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1789117313.852006:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1789117313.852016:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789117313.852018:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789117313.852517:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1789117313.852554:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1789117313.852592:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1789117313.852861:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789117313.852902:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1789117313.852954:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:3.0:1789117313.852971:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789117313.852989:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c178149c400/0xf7565228e460da26 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.853004:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178149c800/0xf7565228e460d93f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460d938 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.853012:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c17c2044200/0xf7565228e460d95b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460d954 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.853018:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178149d000/0xf7565228e460d9cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460d9c4 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.853025:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c178149c400/0xf7565228e460da26 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.853058:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178149d000/0xf7565228e460d9cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460d9c4 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.853071:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c178149d000/0xf7565228e460d9cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460d9c4 expref: 12 pid: 5835 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117313.853084:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305c780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1876025385424000:0@lo:104: 00000100:00100000:3.0:1789117313.853140:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117313.853235:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c17c2044200/0xf7565228e460d95b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460d954 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.853243:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c17c2044200/0xf7565228e460d95b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460d954 expref: 12 pid: 5834 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117313.853263:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305e940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1876025385424128:0@lo:104: 00000100:00100000:3.0:1789117313.853287:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117313.853502:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178149c800/0xf7565228e460d93f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460d938 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.853511:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c178149c800/0xf7565228e460d93f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460d938 expref: 12 pid: 5834 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117313.853519:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305de00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1876025385424256:0@lo:104: 00000100:00100000:3.0:1789117313.853540:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117313.853638:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385424000 00000100:00100000:0.0:1789117313.853644:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385424000 00000100:00100000:3.0:1789117313.853794:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b799ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789117313.853862:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385424128 00000100:00100000:2.0:1789117313.853866:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385424128 00000100:00100000:2.0:1789117313.853879:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385424256 00000100:00100000:2.0:1789117313.853881:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385424256 00000100:00100000:2.0:1789117313.853894:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117313.853901:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179305ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+5:5835:x1876025385424000:12345-0@lo:104: 00010000:00010000:2.0:1789117313.853914:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c1781685000/0xf7565228e460d9c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460d9cb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854004:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789117313.854011:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179305ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+5:5835:x1876025385424000:12345-0@lo:104: Request processed in 110us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117313.854027:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117313.854043:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789117313.854049:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179305f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+4:5835:x1876025385424128:12345-0@lo:104: 00010000:00010000:2.0:1789117313.854056:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c17c2045600/0xf7565228e460d954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460d95b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854085:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789117313.854090:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179305f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+4:5835:x1876025385424128:12345-0@lo:104: Request processed in 42us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117313.854095:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789117313.854105:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789117313.854110:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179305da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:5835:x1876025385424256:12345-0@lo:104: 00010000:00010000:2.0:1789117313.854116:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460d938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460d93f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854138:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789117313.854142:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179305da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:5835:x1876025385424256:12345-0@lo:104: Request processed in 33us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117313.854146:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789117313.854159:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789117313.854164:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c1781685000/0xf7565228e460d9c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460d9cb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854170:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685000 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:2.0:1789117313.854174:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c1781685000/0xf7565228e460d9c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460d9cb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854190:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c1781685000/0xf7565228e460d9c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460d9cb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117313.854197:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c1781685000/0xf7565228e460d9c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460d9cb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117313.854203:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789117313.854227:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c1781685000/0xf7565228e460d9c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460d9cb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854233:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117313.854247:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c1781685000/0xf7565228e460d9c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460d9cb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854254:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c1781685000/0xf7565228e460d9c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460d9cb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854266:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789117313.854269:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c17c2045600/0xf7565228e460d954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460d95b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854274:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2045600 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:2.0:1789117313.854277:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c17c2045600/0xf7565228e460d954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460d95b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854284:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c17c2045600/0xf7565228e460d954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460d95b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117313.854290:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c17c2045600/0xf7565228e460d954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460d95b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117313.854300:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789117313.854311:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c17c2045600/0xf7565228e460d954 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460d95b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854368:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117313.854375:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c17c2045600/0xf7565228e460d954 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460d95b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854381:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c17c2045600/0xf7565228e460d954 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460d95b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854393:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117313.854395:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460d938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460d93f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854423:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2044c00 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:2.0:1789117313.854425:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460d938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460d93f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854431:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460d938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460d93f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117313.854437:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460d938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460d93f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117313.854443:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789117313.854454:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460d938 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460d93f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854459:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117313.854477:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460d938 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460d93f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854483:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460d938 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460d93f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854496:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117313.854498:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117313.854500:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117313.854511:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788840780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385424384:0@lo:103: 00000100:00100000:2.0:1789117313.854538:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117313.854558:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117313.854563:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788842d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385424512:0@lo:103: 00000100:00100000:2.0:1789117313.854581:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117313.854606:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788841a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385424640:0@lo:103: 00000100:00100000:2.0:1789117313.854628:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117313.854730:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385424384 00000100:00100000:2.0:1789117313.854735:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385424384 00010000:00010000:2.0:1789117313.854754:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178149d000/0xf7565228e460d9cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460d9c4 expref: 13 pid: 5835 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117313.854768:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385424512 00000100:00100000:2.0:1789117313.854770:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385424512 00010000:00010000:2.0:1789117313.854780:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c17c2044200/0xf7565228e460d95b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460d954 expref: 14 pid: 5834 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117313.854789:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385424640 00000100:00100000:2.0:1789117313.854791:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385424640 00010000:00010000:2.0:1789117313.854798:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178149c800/0xf7565228e460d93f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460d938 expref: 15 pid: 5834 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117313.854821:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117313.854828:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788841e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:3298:x1876025385424384:12345-0@lo:103: 00010000:00010000:2.0:1789117313.854837:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117313.854842:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178149d000/0xf7565228e460d9cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460d9c4 expref: 15 pid: 5835 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854860:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178149d000/0xf7565228e460d9cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460d9c4 expref: 15 pid: 5835 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854875:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117313.854903:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788841e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:3298:x1876025385424384:12345-0@lo:103: Request processed in 76us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117313.854909:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117313.854923:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789117313.854929:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17888412c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:3298:x1876025385424512:12345-0@lo:103: 00010000:00010000:2.0:1789117313.854936:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117313.854940:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c17c2044200/0xf7565228e460d95b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460d954 expref: 14 pid: 5834 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854948:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c17c2044200/0xf7565228e460d95b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460d954 expref: 14 pid: 5834 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.854957:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117313.854977:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17888412c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:3298:x1876025385424512:12345-0@lo:103: Request processed in 49us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117313.854983:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789117313.854994:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789117313.855006:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:3300:x1876025385424640:12345-0@lo:103: 00010000:00010000:2.0:1789117313.855012:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117313.855016:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178149c800/0xf7565228e460d93f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460d938 expref: 13 pid: 5834 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.855025:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178149c800/0xf7565228e460d93f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460d938 expref: 13 pid: 5834 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.855035:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c178149c400/0xf7565228e460da26 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.855042:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178149c400/0xf7565228e460da26 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.855054:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178149c400/0xf7565228e460da26 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.855060:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178149c400/0xf7565228e460da26 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.855066:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c178149c400/0xf7565228e460da26 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.855072:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c178149c400/0xf7565228e460da26 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.855077:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178149c400 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117313.855081:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c178149c400/0xf7565228e460da26 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.855088:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c178149c400/0xf7565228e460da26 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.855102:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c178149c400/0xf7565228e460da26 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.855112:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117313.855139:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:3300:x1876025385424640:12345-0@lo:103: Request processed in 134us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117313.855145:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789117313.855174:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788841a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385424640:0@lo:103: 00000100:00100000:2.0:1789117313.855217:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788842d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385424512:0@lo:103: 00000100:00100000:2.0:1789117313.855225:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788840780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385424384:0@lo:103: 00010000:00010000:0.0:1789117313.855358:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117313.856951:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178149d000/0xf7565228e460d9cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460d9c4 expref: 12 pid: 5835 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117313.856968:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305c780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1876025385424000:0@lo:104: 00010000:00010000:3.0:1789117313.856987:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c17c2044200/0xf7565228e460d95b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460d954 expref: 11 pid: 5834 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117313.856996:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305e940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1876025385424128:0@lo:104: 00010000:00010000:3.0:1789117313.857006:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178149c800/0xf7565228e460d93f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460d938 expref: 10 pid: 5834 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117313.857017:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305de00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1876025385424256:0@lo:104: 00010000:00010000:3.0:1789117313.857042:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c178149c400/0xf7565228e460da26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.857052:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c178149c400/0xf7565228e460da26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.857069:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c178149c400/0xf7565228e460da26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.857075:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178149c400/0xf7565228e460da26 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789117313.857089:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1789117313.867464:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117313.931173:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+9:6682:x1876025385423872:12345-0@lo:253: Request processed in 85006us (86192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117313.931186:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789117313.931273:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385423872:0@lo:253: 10000000:01000000:2.0:1789117313.931286:0:6682:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789117313.931289:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789117313.931291:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789117313.931292:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117313.931294:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789117313.931295:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117313.931296:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117313.931298:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789117313.931299:0:6682:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789117313.931300:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117313.931302:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789117313.931317:0:6682:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c17c03a3800 from lustre-OST0000 10000000:01000000:2.0:1789117313.931340:0:6682:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789117313.931342:0:6682:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789117313.931348:0:6682:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c17882d4ed8 local copy 10000000:01000000:2.0:1789117313.931351:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789117313.931382:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.931429:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.931439:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117313.931454:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788840780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385424768:0@lo:101: 00000100:00100000:2.0:1789117313.931484:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117313.931526:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681628a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789117313.931660:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385424768 00000100:00100000:0.0:1789117313.931665:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385424768 00000100:00100000:0.0:1789117313.931706:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789117313.931713:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+9:6682:x1876025385424768:12345-0@lo:101: 00010000:00010000:0.0:1789117313.931724:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117313.931737:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1780031400/0xf7565228e460da34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460da2d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117313.931757:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1780031400/0xf7565228e460da34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460da2d expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117313.931767:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1780031400/0xf7565228e460da34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460da2d expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117313.931776:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1780031400, rc 0) 00000100:00100000:0.0:1789117313.931810:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+10:6682:x1876025385424768:12345-0@lo:101: Request processed in 97us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117313.931816:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789117313.931967:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788840780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385424768:0@lo:101: 00010000:00010000:2.0:1789117313.931980:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf7565228e460da34 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.931989:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf7565228e460da34 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117313.932062:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788840780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385424896:0@lo:501: 00000100:00100000:2.0:1789117313.932083:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117313.932101:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681628a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789117313.932145:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385424896 00000100:00100000:0.0:1789117313.932149:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385424896 00000100:00100000:0.0:1789117313.932181:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789117313.932187:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+10:6682:x1876025385424896:12345-0@lo:501: 00000100:00100000:0.0:1789117313.932505:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+10:6682:x1876025385424896:12345-0@lo:501: Request processed in 317us (419us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789117313.932512:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789117313.932608:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788840780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385424896:0@lo:501: 10000000:01000000:3.0:1789117313.932622:0:6682:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789117313.932708:0:6682:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789117313.932715:0:6682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf7565228e460da34 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.932723:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf7565228e460da34 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.932729:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf7565228e460da34 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.932775:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789117313.932792:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c17c03a3800 10000000:01000000:3.0:1789117313.932796:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789117313.932800:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c17882d4ed8 10000000:01000000:3.0:1789117313.932803:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789117313.932806:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c17882d4ed8 from 1 10000000:01000000:3.0:1789117313.932808:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789117313.932825:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149c400/0xf7565228e460da3b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.932838:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178149c400/0xf7565228e460da3b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.932846:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178149c400/0xf7565228e460da3b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117313.932869:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385425024:0@lo:101: 00000100:00100000:3.0:1789117313.932894:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117313.932921:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b799ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117313.932972:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385425024 00000100:00100000:1.0:1789117313.932977:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385425024 00000100:00100000:1.0:1789117313.933035:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789117313.933042:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+10:6682:x1876025385425024:12345-0@lo:101: 00010000:00010000:1.0:1789117313.933050:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117313.933059:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1781685a00/0xf7565228e460da42 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460da3b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117313.933073:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1781685a00/0xf7565228e460da42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460da3b expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117313.933081:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1781685a00/0xf7565228e460da42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460da3b expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117313.933093:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685a00, rc 0) 00000100:00100000:1.0:1789117313.933126:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:6682:x1876025385425024:12345-0@lo:101: Request processed in 85us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117313.933132:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789117313.933192:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385425024:0@lo:101: 00010000:00010000:3.0:1789117313.933202:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178149c400/0xf7565228e460da3b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460da42 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.933210:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178149c400/0xf7565228e460da3b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460da42 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117313.933224:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789117313.933233:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149c400/0xf7565228e460da3b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460da42 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.933240:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178149c400/0xf7565228e460da3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460da42 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117313.933247:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789117313.933250:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789117313.933253:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789117313.933255:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789117313.933265:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460da49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.933275:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460da49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.933283:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460da49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117313.933293:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385425152:0@lo:101: 00000100:00100000:3.0:1789117313.933313:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117313.933334:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117313.933340:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf7565228e460da34 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117313.933347:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2044c00 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:0.0:1789117313.933351:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf7565228e460da34 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117313.933364:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf7565228e460da34 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117313.933371:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf7565228e460da34 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117313.933376:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789117313.933390:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7565228e460da34 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117313.933396:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117313.933436:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7565228e460da34 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117313.933443:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7565228e460da34 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117313.933456:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117313.933458:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117313.933460:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117313.933468:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385425280:0@lo:103: 00000100:00100000:0.0:1789117313.933491:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117313.933524:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385425280 00000100:00100000:0.0:1789117313.933527:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385425280 00000100:00100000:0.0:1789117313.933550:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117313.933555:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be71a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:3301:x1876025385425280:12345-0@lo:103: 00010000:00010000:0.0:1789117313.933564:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117313.933573:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1780031400/0xf7565228e460da34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7565228e460da2d expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117313.933589:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117313.933611:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be71a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+10:3301:x1876025385425280:12345-0@lo:103: Request processed in 56us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117313.933617:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117313.933641:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385425280:0@lo:103: 00000100:00100000:3.0:1789117313.933885:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b799ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789117313.933955:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385425152 00000100:00100000:2.0:1789117313.933959:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385425152 00000100:00100000:2.0:1789117313.933978:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789117313.933984:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+10:6682:x1876025385425152:12345-0@lo:101: 00010000:00010000:2.0:1789117313.933991:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117313.933999:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c17c2045600/0xf7565228e460da50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460da49 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.934023:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c17c2045600/0xf7565228e460da50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460da49 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.934031:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c17c2045600/0xf7565228e460da50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460da49 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.934038:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c17c2045600, rc 0) 00000100:00100000:2.0:1789117313.934070:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:6682:x1876025385425152:12345-0@lo:101: Request processed in 86us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117313.934076:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789117313.934135:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385425152:0@lo:101: 00010000:00010000:3.0:1789117313.934145:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460da49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460da50 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.934153:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460da49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460da50 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117313.934227:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385425408:0@lo:501: 00000100:00100000:3.0:1789117313.934248:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117313.934265:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b799ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789117313.934353:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385425408 00000100:00100000:2.0:1789117313.934357:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385425408 00000100:00100000:2.0:1789117313.934371:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789117313.934376:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:6682:x1876025385425408:12345-0@lo:501: 00000100:00100000:2.0:1789117313.934564:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:6682:x1876025385425408:12345-0@lo:501: Request processed in 186us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117313.934570:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789117313.934633:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385425408:0@lo:501: 00000100:00100000:3.0:1789117313.934723:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385425536:0@lo:503: 00000100:00100000:3.0:1789117313.934755:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117313.934810:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b799ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117313.935095:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385425536 00000100:00100000:1.0:1789117313.935099:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385425536 00000100:00100000:0.0:1789117313.935175:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789117313.935182:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:6682:x1876025385425536:12345-0@lo:503: 00000100:00100000:0.0:1789117313.935311:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:6682:x1876025385425536:12345-0@lo:503: Request processed in 129us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117313.935317:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789117313.935819:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385425536:0@lo:503: 00000040:00080000:0.0:1789117313.936053:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789117313.936105:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be72580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385425664:0@lo:502: 00000100:00100000:0.0:1789117313.936145:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117313.936269:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c056ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789117313.936300:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385425664 00000100:00100000:2.0:1789117313.936304:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385425664 00000100:00100000:2.0:1789117313.936486:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789117313.936495:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:6682:x1876025385425664:12345-0@lo:502: 00000100:00100000:2.0:1789117313.936643:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:6682:x1876025385425664:12345-0@lo:502: Request processed in 150us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117313.936650:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789117313.937202:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be72580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385425664:0@lo:502: 00000040:00080000:0.0:1789117313.937514:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789117313.937564:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789117313.937596:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789117313.937671:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789117313.938603:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789117313.938849:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789117313.938901:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be72580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385425792:0@lo:502: 00000100:00100000:0.0:1789117313.938970:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117313.939018:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c056ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789117313.939075:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385425792 00000100:00100000:2.0:1789117313.939082:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385425792 00000100:00100000:2.0:1789117313.939117:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789117313.939132:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:6682:x1876025385425792:12345-0@lo:502: 00000100:00100000:2.0:1789117313.939579:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:6682:x1876025385425792:12345-0@lo:502: Request processed in 446us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117313.939587:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789117313.939845:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be72580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385425792:0@lo:502: 00000040:00080000:0.0:1789117313.939962:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789117313.939974:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1789117313.942145:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789117313.942155:0:6702:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789117313.942161:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117313.942175:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789117313.942182:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789117313.942205:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c16816eb490) 00000020:00000080:2.0:1789117313.942225:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789117313.942232:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789117313.942572:0:6702:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c17c03a3800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789117313.942581:0:6702:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789117313.942598:0:6702:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf7565228e460da5e 00010000:00010000:2.0:1789117313.952838:0:6702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1789117313.953091:0:6702:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789117313.957451:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789117313.957962:0:6702:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789117313.967330:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789117313.968585:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789117313.971373:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789117313.971384:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117313.971390:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117313.971393:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789117313.971396:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117313.971477:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117313.971479:0:6702:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789117313.971483:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789117313.971486:0:6702:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789117313.971525:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117313.971535:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117313.971536:0:6702:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789117313.971540:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789117313.973566:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789117313.973598:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789117313.973631:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460da49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460da50 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.973660:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460da49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460da50 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117313.978368:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c17c03a3800 from 1 10000000:01000000:2.0:1789117313.978377:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789117313.978440:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460da65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.978453:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460da65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.978463:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460da65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117313.978485:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788842d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385425920:0@lo:101: 00000100:00100000:2.0:1789117313.978545:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117313.978592:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c16816286c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117313.978942:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385425920 00000100:00100000:3.0:1789117313.978952:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385425920 00000100:00100000:3.0:1789117313.979003:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789117313.979012:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:6682:x1876025385425920:12345-0@lo:101: 00010000:00010000:3.0:1789117313.979025:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117313.979038:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178149d000/0xf7565228e460da6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460da65 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.979060:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178149d000/0xf7565228e460da6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460da65 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.979071:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178149d000/0xf7565228e460da6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460da65 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.979080:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178149d000, rc 0) 00000100:00100000:3.0:1789117313.979121:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:6682:x1876025385425920:12345-0@lo:101: Request processed in 110us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117313.979128:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789117313.979220:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788842d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385425920:0@lo:101: 00010000:00010000:2.0:1789117313.979237:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460da65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460da6c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.979246:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460da65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460da6c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117313.979586:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788842d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385426048:0@lo:501: 00000100:00100000:2.0:1789117313.979626:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117313.979662:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c16816286c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117313.983897:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385426048 00000100:00100000:0.0:1789117313.983910:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385426048 00000100:00100000:0.0:1789117313.984010:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789117313.984021:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:6682:x1876025385426048:12345-0@lo:501: 00000100:00100000:0.0:1789117313.984476:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:6682:x1876025385426048:12345-0@lo:501: Request processed in 455us (4847us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117313.984484:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789117313.986348:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788842d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385426048:0@lo:501: 00000100:00100000:2.0:1789117313.986421:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788842d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385426176:0@lo:503: 00000100:00100000:2.0:1789117313.986484:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117313.988697:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c16816286c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117313.988921:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385426176 00000100:00100000:3.0:1789117313.988929:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385426176 00000100:00100000:3.0:1789117313.988967:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789117313.988975:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:6682:x1876025385426176:12345-0@lo:503: 00000100:00100000:3.0:1789117313.989224:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:6682:x1876025385426176:12345-0@lo:503: Request processed in 248us (2738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117313.989242:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789117313.989500:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788842d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385426176:0@lo:503: 00000040:00080000:3.0:1789117313.989790:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789117313.989868:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385426304:0@lo:502: 00000100:00100000:3.0:1789117313.989911:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117313.989935:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b799a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117313.990200:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385426304 00000100:00100000:1.0:1789117313.990205:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385426304 00000100:00100000:1.0:1789117313.990229:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789117313.990236:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:6682:x1876025385426304:12345-0@lo:502: 00000100:00100000:1.0:1789117313.990579:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:6682:x1876025385426304:12345-0@lo:502: Request processed in 343us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117313.990586:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789117313.990668:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385426304:0@lo:502: 00000040:00080000:1.0:1789117313.990911:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789117313.990956:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789117313.990981:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178bec8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385426432:0@lo:502: 00000100:00100000:1.0:1789117313.991014:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117313.991031:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178303a780 going to sleep for 11 seconds 00000100:00100000:1.0:1789117313.991047:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385426432 00000100:00100000:1.0:1789117313.991051:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385426432 00000100:00100000:1.0:1789117313.991070:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789117313.991076:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:6682:x1876025385426432:12345-0@lo:502: 00000100:00100000:1.0:1789117313.991213:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:6682:x1876025385426432:12345-0@lo:502: Request processed in 135us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117313.991220:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789117313.991264:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178bec8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385426432:0@lo:502: 00000040:00080000:1.0:1789117313.991349:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789117313.991370:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789117313.993051:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117313.993078:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117313.993081:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789117313.993089:0:6706:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c17c03a3800 00000020:00000080:2.0:1789117313.993091:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789117313.993122:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117313.993125:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117313.993127:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789117313.993130:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789117313.994842:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789117313.994891:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117313.994951:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460da65 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460da6c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117313.994965:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460da65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460da6c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117313.998586:0:6682:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789117313.998594:0:6682:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c17c03a3800 10000000:01000000:2.0:1789117313.998598:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c17c03a3800 10000000:01000000:2.0:1789117313.998604:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789117313.998889:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c17c03a3800 from 1 10000000:01000000:2.0:1789117313.998893:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789117313.998933:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.998944:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117313.998955:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117313.998977:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788841a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385426560:0@lo:101: 00000100:00100000:2.0:1789117313.999045:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117313.999533:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681628600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117314.000497:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385426560 00000100:00100000:1.0:1789117314.000508:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385426560 00000100:00100000:1.0:1789117314.000568:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789117314.000578:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:6682:x1876025385426560:12345-0@lo:101: 00010000:00010000:1.0:1789117314.000595:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117314.000625:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1781685200/0xf7565228e460da7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460da73 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117314.000782:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1781685200/0xf7565228e460da7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460da73 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117314.000795:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1781685200/0xf7565228e460da7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460da73 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117314.000805:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685200, rc 0) 00000100:00100000:1.0:1789117314.000875:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:6682:x1876025385426560:12345-0@lo:101: Request processed in 299us (1830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117314.000882:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789117314.001104:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788841a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385426560:0@lo:101: 00010000:00010000:2.0:1789117314.001121:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460da7a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117314.001142:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460da7a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117314.001377:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788841a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385426688:0@lo:501: 00000100:00100000:2.0:1789117314.001828:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117314.001882:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681628600 going to sleep for 11 seconds 00000100:00100000:0.0:1789117314.001939:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385426688 00000100:00100000:0.0:1789117314.001944:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385426688 00000100:00100000:0.0:1789117314.001984:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789117314.001992:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:6682:x1876025385426688:12345-0@lo:501: 00000100:00100000:0.0:1789117314.002221:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:6682:x1876025385426688:12345-0@lo:501: Request processed in 229us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117314.002228:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789117314.002833:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788841a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385426688:0@lo:501: 00000100:00100000:1.0:1789117314.002891:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178bec8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385426816:0@lo:503: 00000100:00100000:1.0:1789117314.002935:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117314.002957:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178303a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789117314.003080:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385426816 00000100:00100000:3.0:1789117314.003085:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385426816 00000100:00100000:3.0:1789117314.003124:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789117314.003132:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:6682:x1876025385426816:12345-0@lo:503: 00000100:00100000:3.0:1789117314.003317:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:6682:x1876025385426816:12345-0@lo:503: Request processed in 184us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117314.003324:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789117314.003623:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178bec8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385426816:0@lo:503: 00000040:00080000:1.0:1789117314.003884:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789117314.003950:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178bec8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385426944:0@lo:502: 00000100:00100000:1.0:1789117314.003983:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117314.004003:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178303a000 going to sleep for 11 seconds 00000100:00100000:1.0:1789117314.004020:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385426944 00000100:00100000:1.0:1789117314.004023:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385426944 00000100:00100000:1.0:1789117314.004041:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789117314.004046:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:6682:x1876025385426944:12345-0@lo:502: 00000100:00100000:1.0:1789117314.004205:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:6682:x1876025385426944:12345-0@lo:502: Request processed in 158us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117314.004212:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789117314.004249:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178bec8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385426944:0@lo:502: 00000040:00080000:1.0:1789117314.004549:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789117314.004595:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789117314.004624:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789117314.004664:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789117314.004701:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789117314.004747:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789117314.004785:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789117314.004820:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789117314.004882:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789117314.004919:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789117314.004948:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789117314.004989:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789117314.005022:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789117314.005054:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789117314.005097:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789117314.005131:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789117314.005164:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789117314.005219:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789117314.005254:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789117314.005298:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789117314.005360:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789117314.005396:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789117314.005464:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789117314.005524:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789117314.005573:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789117314.005607:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789117314.005654:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789117314.005689:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1789117314.005724:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178bec8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385427072:0@lo:502: 00000100:00100000:1.0:1789117314.005782:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117314.005823:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385427072 00000100:00100000:1.0:1789117314.005829:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385427072 00000100:00100000:1.0:1789117314.005871:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789117314.005880:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:6682:x1876025385427072:12345-0@lo:502: 00000100:00100000:1.0:1789117314.006048:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:6682:x1876025385427072:12345-0@lo:502: Request processed in 168us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117314.006055:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789117314.006091:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178303a000 going to sleep for 11 seconds 00000100:00100000:1.0:1789117314.006108:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178bec8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385427072:0@lo:502: 00000040:00080000:1.0:1789117314.006164:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789117314.006173:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789117314.012084:0:6707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789117314.012103:0:6707:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c17c1c60000) 00000020:00000080:3.0:1789117314.012125:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1789117314.012359:0:6707:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c17c03a3800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789117314.012364:0:6707:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c17c03a3800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789117314.012366:0:6707:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c17c03a3800 3 00010000:00080000:3.0:1789117314.012523:0:6707:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1681d63000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.137@tcp at head 00010000:00010000:3.0:1789117314.016843:0:6707:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1789117314.017111:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789117314.017147:0:6707:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789117314.017160:0:6707:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf7565228e460da88 00000100:00080000:3.0:1789117314.017244:0:6707:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789117314.017251:0:6707:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c1681d63000 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:3.0:1789117314.017294:0:6707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c179305c780 x1876025385427200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789117314.017362:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876025385427200:0@lo:38: 00000100:00100000:0.0:1789117314.017455:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789117314.017533:0:6707:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789117314.017641:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385427200 00000100:00100000:2.0:1789117314.017648:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385427200 00000100:00100000:2.0:1789117314.017689:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117314.017697:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1876025385427200:12345-0@lo:38: 00010000:00080000:2.0:1789117314.017719:0:5841:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:2.0:1789117314.017749:0:5841:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf7565228e460da8f 00000004:00100000:2.0:1789117314.017763:0:5841:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789117314.017791:0:5841:0:(import.c:65:import_set_state_nolock()) ffff9c16816f0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789117314.026471:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117314.026494:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876025385427328:0@lo:400: 00000100:00100000:3.0:1789117314.026558:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117314.026807:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1876025385427200:12345-0@lo:38: Request processed in 9108us (9350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117314.026817:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117314.026841:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385427328 00000100:00100000:2.0:1789117314.026848:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385427328 00000100:00100000:2.0:1789117314.026891:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117314.026898:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179305f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876025385427328:12345-0@lo:400: 00000100:00100000:2.0:1789117314.026996:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179305f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876025385427328:12345-0@lo:400: Request processed in 98us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117314.027002:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789117314.028240:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c179305c780 x1876025385427200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789117324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117314.028252:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789117314.028261:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789117314.028268:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789117314.028272:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789117314.028275:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c1681d63000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789117314.028290:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876025385427200:0@lo:38: 00000040:00080000:1.0:1789117314.029957:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1789117314.030011:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789117314.030036:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789117314.030050:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460da7a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117314.030061:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460da7a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789117314.030120:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789117314.030122:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789117314.030124:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789117314.030125:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789117314.030126:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789117314.030127:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789117314.030129:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789117314.030130:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789117314.030131:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789117314.030133:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789117314.030134:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789117314.030137:0:6682:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789117314.030140:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789117314.030141:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789117314.030142:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789117314.030143:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789117314.030144:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789117314.030145:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789117314.030146:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789117314.030147:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789117314.030148:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789117314.030149:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789117314.030150:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789117314.030184:0:6682:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789117314.030201:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178bec8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385427456:0@lo:253: 00000100:00100000:1.0:1789117314.030262:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117314.030308:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178303a000 going to sleep for 11 seconds 00000100:00100000:1.0:1789117314.030330:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385427456 00000100:00100000:1.0:1789117314.030336:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385427456 00000100:00100000:1.0:1789117314.030374:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789117314.030383:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:6682:x1876025385427456:12345-0@lo:253: 20000000:01000000:1.0:1789117314.030425:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789117314.030438:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1789117314.039224:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c179305cb40 x1876025385427328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117314.039242:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876025385427328:0@lo:400: 20000000:01000000:1.0:1789117314.064954:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789117314.065008:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789117314.071144:0:5855:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789117314.071154:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789117314.071183:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c178149cc00/0xf7565228e460da96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.071199:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178149c200/0xf7565228e460d9f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460d9ee expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.071207:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c178149cc00/0xf7565228e460da96 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.071244:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178149c200/0xf7565228e460d9f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460d9ee expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.071271:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c178149c200/0xf7565228e460d9f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460d9ee expref: 13 pid: 5834 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117314.071293:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305cb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1876025385427584:0@lo:104: 00000100:00100000:3.0:1789117314.071362:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117314.071419:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b799a780 going to sleep for 11 seconds 00000100:00100000:1.0:1789117314.071683:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385427584 00000100:00100000:1.0:1789117314.071690:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385427584 00000100:00100000:1.0:1789117314.071735:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789117314.071745:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179305c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:5855:x1876025385427584:12345-0@lo:104: 00010000:00010000:1.0:1789117314.071757:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460d9ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460d9f5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117314.071811:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789117314.071817:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179305c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:5855:x1876025385427584:12345-0@lo:104: Request processed in 75us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117314.071823:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789117314.071994:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305cb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1876025385427584:0@lo:104: 00010000:00010000:3.0:1789117314.072014:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c178149cc00/0xf7565228e460da96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.072030:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117314.072035:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460d9ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460d9f5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.072042:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685600 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:3.0:1789117314.072046:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460d9ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460d9f5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.072053:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460d9ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460d9f5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117314.072060:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460d9ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460d9f5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117314.072065:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789117314.072096:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460d9ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460d9f5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.072103:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117314.072133:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460d9ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460d9f5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.072139:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460d9ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460d9f5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.072155:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117314.072156:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117314.072158:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117314.072172:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117314.072183:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385427712:0@lo:103: 00000100:00100000:3.0:1789117314.072213:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117314.072242:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385427712 00000100:00100000:3.0:1789117314.072246:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385427712 00010000:00010000:3.0:1789117314.072260:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178149c200/0xf7565228e460d9f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460d9ee expref: 14 pid: 5834 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117314.072291:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789117314.072297:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17845e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:3298:x1876025385427712:12345-0@lo:103: 00010000:00010000:3.0:1789117314.072306:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117314.072312:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178149c200/0xf7565228e460d9f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460d9ee expref: 14 pid: 5834 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.072321:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178149c200/0xf7565228e460d9f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460d9ee expref: 14 pid: 5834 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.072334:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178149c200/0xf7565228e460d9f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460d9ee expref: 14 pid: 5834 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.072347:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c178149cc00/0xf7565228e460da96 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.072592:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178149cc00/0xf7565228e460da96 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789117314.072605:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002551426s 00010000:00010000:3.0:1789117314.072610:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178149cc00/0xf7565228e460da96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.072616:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178149cc00/0xf7565228e460da96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.072622:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c178149cc00/0xf7565228e460da96 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.072629:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c178149cc00/0xf7565228e460da96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.072635:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178149cc00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117314.072638:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c178149cc00/0xf7565228e460da96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.072646:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c178149cc00/0xf7565228e460da96 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117314.072820:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:6682:x1876025385427456:12345-0@lo:253: Request processed in 42436us (42556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117314.072829:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1789117314.072975:0:5855:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c178149cc00/0xf7565228e460da96 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117314.072983:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178bec8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6682:1876025385427456:0@lo:253: 00010000:00010000:2.0:1789117314.072993:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c178149cc00/0xf7565228e460da96 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117314.072993:0:6682:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789117314.072995:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789117314.072997:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789117314.072999:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117314.073000:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117314.073001:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117314.073002:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117314.073004:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789117314.073005:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789117314.073007:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789117314.073008:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117314.073009:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789117314.073021:0:6682:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789117314.073026:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c178149cc00/0xf7565228e460da96 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.073033:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178149cc00/0xf7565228e460da96 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117314.073044:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117314.073119:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17845e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:3298:x1876025385427712:12345-0@lo:103: Request processed in 822us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117314.073131:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789117314.073219:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385427712:0@lo:103: 00080000:10000000:1.0:1789117314.080557:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789117314.081456:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789117314.081703:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789117314.083833:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789117314.084706:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:1.0:1789117314.084942:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789117314.089250:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789117314.328833:0:6682:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789117314.328839:0:6682:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789117314.328878:0:6682:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789117314.328928:0:6682:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.137@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789117314.328950:0:6682:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789117314.328973:0:6682:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789117314.893066:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117315.909647:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117316.933630:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117317.957922:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789117318.726035:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789117318.726042:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c178548d000 from 21 10000000:01000000:0.0:1789117318.726047:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789117318.726093:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1780030400/0xf7565228e460da9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117318.726104:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c1780030400/0xf7565228e460da9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117318.726129:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c1780030400/0xf7565228e460da9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117318.726163:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385427840:0@lo:101: 00000100:00100000:0.0:1789117318.726229:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117318.726285:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785d60600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117318.726421:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385427840 00000100:00100000:1.0:1789117318.726429:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385427840 00000100:00100000:1.0:1789117318.726478:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789117318.726488:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:5837:x1876025385427840:12345-0@lo:101: 00010000:00010000:1.0:1789117318.726500:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117318.726512:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1781685400/0xf7565228e460daa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460da9d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117318.726536:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1781685400/0xf7565228e460daa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460da9d expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117318.726556:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1781685400/0xf7565228e460daa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460da9d expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117318.726565:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685400, rc 0) 00000100:00100000:1.0:1789117318.726615:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:5837:x1876025385427840:12345-0@lo:101: Request processed in 129us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117318.726622:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789117318.726770:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385427840:0@lo:101: 00010000:00010000:0.0:1789117318.726784:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c1780030400/0xf7565228e460da9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460daa4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117318.726793:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c1780030400/0xf7565228e460da9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460daa4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117318.726858:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385427968:0@lo:501: 00000100:00100000:0.0:1789117318.727008:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117318.727038:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785d60600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117318.727093:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385427968 00000100:00100000:1.0:1789117318.727097:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385427968 00000100:00100000:1.0:1789117318.727127:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789117318.727133:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:5837:x1876025385427968:12345-0@lo:501: 00000100:00100000:1.0:1789117318.727359:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:5837:x1876025385427968:12345-0@lo:501: Request processed in 225us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117318.727367:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789117318.727513:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385427968:0@lo:501: 00000100:00100000:0.0:1789117318.727543:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385428096:0@lo:503: 00000100:00100000:0.0:1789117318.727581:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117318.727685:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785d60600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117318.727994:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385428096 00000100:00100000:1.0:1789117318.727999:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385428096 00000100:00100000:1.0:1789117318.728032:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789117318.728039:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:5837:x1876025385428096:12345-0@lo:503: 00000100:00100000:1.0:1789117318.728304:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:5837:x1876025385428096:12345-0@lo:503: Request processed in 263us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117318.728311:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789117318.728433:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385428096:0@lo:503: 00000100:00100000:3.0:1789117318.729029:0:6985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6985:1876025385428224:0@lo:502: 00000100:00100000:3.0:1789117318.729077:0:6985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117318.729112:0:6985:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1784dcf480 going to sleep for 11 seconds 00000100:00100000:0.0:1789117318.729326:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385428224 00000100:00100000:0.0:1789117318.729332:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385428224 00000100:00100000:0.0:1789117318.729369:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789117318.729377:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:6985:x1876025385428224:12345-0@lo:502: 00000100:00100000:0.0:1789117318.729585:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:6985:x1876025385428224:12345-0@lo:502: Request processed in 209us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117318.730762:0:6985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6985:1876025385428224:0@lo:502: 00000100:00100000:0.0:1789117318.730990:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789117318.731333:0:6985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6985:1876025385428352:0@lo:502: 00000100:00100000:3.0:1789117318.731389:0:6985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117318.731442:0:6985:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17ad1bb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117318.731509:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385428352 00000100:00100000:0.0:1789117318.731514:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385428352 00000100:00100000:0.0:1789117318.732989:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789117318.733008:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:6985:x1876025385428352:12345-0@lo:502: 00000100:00100000:0.0:1789117318.733244:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:6985:x1876025385428352:12345-0@lo:502: Request processed in 243us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117318.733251:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789117318.735807:0:6985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6985:1876025385428352:0@lo:502: 00000040:00080000:3.0:1789117318.735869:0:6985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789117318.737121:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789117318.737146:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789117318.737156:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1780030400/0xf7565228e460da9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460daa4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117318.737168:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c1780030400/0xf7565228e460da9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460daa4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117318.737178:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789117318.737180:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c178548d000 from 4 10000000:01000000:0.0:1789117318.737183:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789117318.737218:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460daab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117318.737227:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460daab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117318.737237:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460daab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117318.737255:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385428480:0@lo:101: 00000100:00100000:0.0:1789117318.737317:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117318.737365:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785d60f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117318.737988:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385428480 00000100:00100000:1.0:1789117318.737996:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385428480 00000100:00100000:1.0:1789117318.738034:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789117318.738043:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:5837:x1876025385428480:12345-0@lo:101: 00010000:00010000:1.0:1789117318.738055:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117318.738073:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1781685000/0xf7565228e460dab2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460daab expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117318.738097:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1781685000/0xf7565228e460dab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460daab expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117318.738108:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1781685000/0xf7565228e460dab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460daab expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117318.738117:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685000, rc 0) 00000100:00100000:1.0:1789117318.738169:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:5837:x1876025385428480:12345-0@lo:101: Request processed in 127us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117318.738176:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789117318.739008:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385428480:0@lo:101: 00010000:00010000:3.0:1789117318.739026:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460daab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dab2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117318.739037:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460daab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dab2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117318.739092:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385428608:0@lo:256: 00000100:00100000:3.0:1789117318.739132:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117318.739159:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1784dcf480 going to sleep for 11 seconds 00000100:00100000:0.0:1789117318.739224:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385428608 00000100:00100000:0.0:1789117318.739229:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385428608 00000100:00100000:0.0:1789117318.739263:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789117318.739270:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:5837:x1876025385428608:12345-0@lo:256: 20000000:01000000:0.0:1789117318.739285:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789117318.739299:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789117318.739303:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789117318.739376:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:5837:x1876025385428608:12345-0@lo:256: Request processed in 105us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117318.739383:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789117318.739436:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385428608:0@lo:256: 10000000:01000000:0.0:1789117318.739475:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789117318.739481:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460daab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dab2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117318.739489:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460daab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dab2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117318.739497:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789117318.739499:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789117318.739502:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789117318.739520:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1780030200/0xf7565228e460dab9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117318.739527:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c1780030200/0xf7565228e460dab9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117318.739545:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c1780030200/0xf7565228e460dab9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117318.739559:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be712c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385428736:0@lo:101: 00000100:00100000:0.0:1789117318.739582:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117318.739811:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785d60840 going to sleep for 11 seconds 00000100:00100000:3.0:1789117318.743850:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385428736 00000100:00100000:3.0:1789117318.743871:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385428736 00000100:00100000:3.0:1789117318.743920:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789117318.743929:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:5837:x1876025385428736:12345-0@lo:101: 00010000:00010000:3.0:1789117318.743943:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117318.743958:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178149cc00/0xf7565228e460dac0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dab9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117318.743983:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178149cc00/0xf7565228e460dac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dab9 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117318.743993:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178149cc00/0xf7565228e460dac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dab9 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117318.744003:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178149cc00, rc 0) 00000100:00100000:3.0:1789117318.744065:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:5837:x1876025385428736:12345-0@lo:101: Request processed in 137us (4481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117318.744072:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789117318.749170:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be712c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385428736:0@lo:101: 00010000:00010000:0.0:1789117318.749196:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c1780030200/0xf7565228e460dab9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dac0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117318.749209:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c1780030200/0xf7565228e460dab9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dac0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117318.749282:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be712c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385428864:0@lo:501: 00000100:00100000:0.0:1789117318.749337:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117318.749439:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785d60840 going to sleep for 11 seconds 00000100:00100000:3.0:1789117318.752558:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385428864 00000100:00100000:3.0:1789117318.752569:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385428864 00000100:00100000:3.0:1789117318.752681:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789117318.752691:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:5837:x1876025385428864:12345-0@lo:501: 00000100:00100000:3.0:1789117318.753095:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:5837:x1876025385428864:12345-0@lo:501: Request processed in 405us (3756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117318.753102:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789117318.754468:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be712c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385428864:0@lo:501: 00000100:00100000:2.0:1789117318.754522:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788843480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385428992:0@lo:503: 00000100:00100000:2.0:1789117318.754580:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117318.754691:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1784c2a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117318.754767:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385428992 00000100:00100000:1.0:1789117318.754773:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385428992 00000100:00100000:1.0:1789117318.754811:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789117318.754949:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:5837:x1876025385428992:12345-0@lo:503: 00000100:00100000:1.0:1789117318.755179:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:5837:x1876025385428992:12345-0@lo:503: Request processed in 360us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117318.755187:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789117318.755274:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788843480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385428992:0@lo:503: 00000100:00100000:2.0:1789117318.765155:0:6986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788843480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6986:1876025385429120:0@lo:502: 00000100:00100000:2.0:1789117318.765227:0:6986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117318.765262:0:6986:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1784c2a240 going to sleep for 11 seconds 00000100:00100000:0.0:1789117318.765511:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385429120 00000100:00100000:0.0:1789117318.765519:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385429120 00000100:00100000:0.0:1789117318.765964:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789117318.765975:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:6986:x1876025385429120:12345-0@lo:502: 00000100:00100000:0.0:1789117318.766251:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:6986:x1876025385429120:12345-0@lo:502: Request processed in 277us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117318.766258:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789117318.767077:0:6986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788843480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6986:1876025385429120:0@lo:502: 00000020:01000000:0.0:1789117318.767108:0:6986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789117318.767121:0:6986:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789117318.767127:0:6986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117318.767129:0:6986:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789117318.767134:0:6986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789117318.767137:0:6986:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.137@tcp to nid 0x20000c0a8ce89 (192.168.206.137@tcp) 00000020:01000000:0.0:1789117318.767157:0:6986:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789117318.767159:0:6986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789117318.767173:0:6986:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c1788299a48) 00000020:00000080:0.0:1789117318.767191:0:6986:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789117318.767196:0:6986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789117318.767262:0:6986:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789117318.767267:0:6986:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789117318.767274:0:6986:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7565228e460dace 00010000:00080000:0.0:1789117318.767300:0:6986:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c16816b5000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.137@tcp at head 00010000:00010000:0.0:1789117318.767518:0:6986:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789117318.879610:0:6986:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789117318.879637:0:6986:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789117318.880245:0:6986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789117318.881005:0:6986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789117318.881060:0:6986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789117318.881121:0:6986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789117318.890642:0:6991:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789117318.890650:0:6991:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789117318.891845:0:6986:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789117318.891859:0:6986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789117318.892641:0:6986:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789117318.892663:0:6986:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7565228e460dad5 00000100:00080000:2.0:1789117318.892673:0:6986:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789117318.892678:0:6986:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c16816b5000 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:2.0:1789117318.892711:0:6986:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1788841a40 x1876025385429248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789117318.892741:0:6986:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789117318.892812:0:6986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117318.892833:0:6986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117318.892835:0:6986:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789117318.892839:0:6986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117318.892843:0:6986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117318.892844:0:6986:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789117318.892847:0:6986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789117318.892848:0:6986:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789117318.892875:0:6986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788842d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6986:1876025385429376:0@lo:502: 00000100:00100000:1.0:1789117318.893044:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178beca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385429504:0@lo:400: 00000100:00100000:1.0:1789117318.893102:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117318.893147:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117318.893153:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178bec8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385429632:0@lo:400: 00000100:00100000:1.0:1789117318.893189:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117318.893223:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117318.893230:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178bec9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385429760:0@lo:400: 00000100:00100000:1.0:1789117318.893258:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117318.893290:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385429504 00000100:00100000:1.0:1789117318.893296:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385429504 00000100:00100000:1.0:1789117318.893332:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789117318.893340:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:3300:x1876025385429504:12345-0@lo:400: 00000100:00100000:1.0:1789117318.893385:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:3300:x1876025385429504:12345-0@lo:400: Request processed in 46us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117318.893392:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789117318.893447:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385429632 00000100:00100000:1.0:1789117318.893451:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385429632 00000100:00100000:1.0:1789117318.893473:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385429760 00000100:00100000:1.0:1789117318.893476:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385429760 00000100:00100000:1.0:1789117318.893497:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789117318.893504:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178becad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385429632:12345-0@lo:400: 00000100:00100000:1.0:1789117318.893534:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178becad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385429632:12345-0@lo:400: Request processed in 31us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117318.893540:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789117318.893551:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789117318.893557:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178bec83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385429760:12345-0@lo:400: 00000100:00100000:1.0:1789117318.893586:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178bec83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385429760:12345-0@lo:400: Request processed in 29us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117318.893591:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789117318.893626:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c178bec9e00 x1876025385429760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117318.893652:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178bec9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385429760:0@lo:400: 00010000:00080000:1.0:1789117318.893682:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c178bec8780 x1876025385429632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117318.893691:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178bec8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385429632:0@lo:400: 00000100:00100000:1.0:1789117318.893699:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178beca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385429504:0@lo:400: 00000100:00100000:2.0:1789117318.893812:0:6986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117318.894009:0:6986:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1784c2a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789117318.894182:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788841a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385429248:0@lo:8: 00000100:00100000:3.0:1789117318.894214:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789117318.894294:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117318.894309:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385429248 00000100:00100000:3.0:1789117318.894313:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385429248 00000100:00100000:3.0:1789117318.894352:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789117318.894357:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179305e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876025385429248:12345-0@lo:8: 00010000:00080000:3.0:1789117318.894377:0:6685:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:3.0:1789117318.894422:0:6685:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7565228e460dadc 00002000:00100000:3.0:1789117318.894459:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c1681d65800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789117318.894464:0:6685:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1789117318.894467:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789117318.894582:0:6685:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789117318.894710:0:6685:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789117318.894734:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9c1681d67000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789117318.894775:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179305e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3297:x1876025385429248:12345-0@lo:8: Request processed in 416us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117318.894782:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789117318.894811:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1788841a40 x1876025385429248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789117328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117318.894819:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789117318.894835:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789117318.894843:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789117318.894847:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789117318.894850:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c16816b5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789117318.894862:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789117318.894867:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788841a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385429248:0@lo:8: 00000100:00100000:1.0:1789117318.895380:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385429376 00000100:00100000:1.0:1789117318.895386:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385429376 00000100:00100000:1.0:1789117318.895445:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789117318.895453:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:6986:x1876025385429376:12345-0@lo:502: 00000100:00100000:1.0:1789117318.895654:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:6986:x1876025385429376:12345-0@lo:502: Request processed in 201us (1841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117318.895660:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789117318.895990:0:6986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788842d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:6986:1876025385429376:0@lo:502: 00000020:01000000:2.0:1789117318.896020:0:6986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117318.896026:0:6986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117318.896029:0:6986:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789117318.896033:0:6986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1789117318.896145:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1789117318.896161:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789117318.896170:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1780030200/0xf7565228e460dab9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dac0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117318.896179:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c1780030200/0xf7565228e460dab9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dac0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117318.896188:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789117318.896191:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c17882d4ed8 from 1 10000000:01000000:2.0:1789117318.896193:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789117318.896220:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2045800/0xf7565228e460dae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789117318.896306:0:6991:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789117318.896424:0:6991:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 166026022885ns, next at 0ns, rc = 0 00010000:00010000:2.0:1789117318.898017:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c17c2045800/0xf7565228e460dae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117318.898051:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c17c2045800/0xf7565228e460dae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117318.898087:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788842d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385429888:0@lo:101: 00000100:00100000:2.0:1789117318.898143:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117318.898180:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1784c2a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789117318.898200:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385429888 00000100:00100000:2.0:1789117318.898206:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385429888 00000100:00100000:2.0:1789117318.898311:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789117318.898321:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:5837:x1876025385429888:12345-0@lo:101: 00010000:00010000:2.0:1789117318.898333:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117318.898348:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c17c2044800/0xf7565228e460daea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dae3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117318.898371:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c17c2044800/0xf7565228e460daea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dae3 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117318.898382:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c17c2044800/0xf7565228e460daea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dae3 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117318.898391:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c17c2044800, rc 0) 00000100:00100000:2.0:1789117318.898440:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:5837:x1876025385429888:12345-0@lo:101: Request processed in 121us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117318.898447:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789117318.898485:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788842d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385429888:0@lo:101: 00010000:00010000:2.0:1789117318.898498:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c17c2045800/0xf7565228e460dae3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460daea expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117318.898516:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c17c2045800/0xf7565228e460dae3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460daea expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117318.898565:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788842d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385430016:0@lo:501: 00000100:00100000:2.0:1789117318.898589:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117318.898601:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1784c2a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789117318.898612:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385430016 00000100:00100000:2.0:1789117318.898615:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385430016 00000100:00100000:2.0:1789117318.898631:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789117318.898636:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:5837:x1876025385430016:12345-0@lo:501: 00000100:00100000:2.0:1789117318.898810:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:5837:x1876025385430016:12345-0@lo:501: Request processed in 172us (218us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789117318.898816:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789117318.898856:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788842d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385430016:0@lo:501: 10000000:01000000:2.0:1789117318.898877:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789117318.900987:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2045800/0xf7565228e460dae3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460daea expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117318.901004:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c17c2045800/0xf7565228e460dae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460daea expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789117318.959259:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1789117318.985288:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117318.987251:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788842d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385430144:0@lo:13: 00000100:00100000:2.0:1789117318.987319:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117318.987389:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385430144 00000100:00100000:2.0:1789117318.987396:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385430144 00000100:00100000:2.0:1789117318.987461:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789117318.987481:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788840780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876025385430144:12345-0@lo:13: 00002000:00000024:2.0:1789117318.987512:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1789117318.987554:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788840780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876025385430144:12345-0@lo:13: Request processed in 74us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117318.987561:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789117318.987581:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789117318.987607:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1788842d00 x1876025385430144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117318.987625:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788842d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385430144:0@lo:13: 00000004:00080000:2.0:1789117318.987644:0:6994:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789117318.987662:0:6994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788842d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6994:1876025385430272:0@lo:7: 00000100:00100000:2.0:1789117318.987687:0:6994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117318.987724:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385430272 00000100:00100000:2.0:1789117318.987727:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385430272 00000100:00100000:2.0:1789117318.987751:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117318.987758:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788840f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6994:x1876025385430272:12345-0@lo:7: 00000100:00100000:3.0:1789117318.994479:0:6994:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1784c2a9c0 going to sleep for 11 seconds 00002000:00080000:2.0:1789117318.997081:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789117318.997090:0:6687:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789117318.997244:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788840f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6994:x1876025385430272:12345-0@lo:7: Request processed in 9481us (9551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117318.997255:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789117318.997320:0:6994:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1788842d00 x1876025385430272/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789117334 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117318.997334:0:6994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788842d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6994:1876025385430272:0@lo:7: 00000004:00080000:2.0:1789117318.997346:0:6994:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789117318.997382:0:6994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788842d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6994:1876025385430400:0@lo:5: 00000100:00100000:2.0:1789117318.997532:0:6994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117318.997561:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385430400 00000100:00100000:2.0:1789117318.997567:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385430400 00000100:00100000:2.0:1789117318.997641:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117318.997652:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788842940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6994:x1876025385430400:12345-0@lo:5: 00002000:00080000:2.0:1789117318.997677:0:6686:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789117318.997681:0:6686:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789117318.997891:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788842940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6994:x1876025385430400:12345-0@lo:5: Request processed in 230us (348us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789117318.997898:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117318.998046:0:6994:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1784c2a9c0 going to sleep for 11 seconds 00010000:00080000:2.0:1789117318.998062:0:6994:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1788842d00 x1876025385430400/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789117334 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117318.998074:0:6994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788842d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6994:1876025385430400:0@lo:5: 00000004:00080000:2.0:1789117318.998082:0:6994:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789117318.998106:0:6994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788840b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6994:1876025385430528:0@lo:700: 00000100:00100000:2.0:1789117318.998130:0:6994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117318.998261:0:6994:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1784c2a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117318.998306:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385430528 00000100:00100000:0.0:1789117318.998311:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385430528 00000100:00100000:0.0:1789117318.998382:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117318.998390:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788843c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6994:x1876025385430528:12345-0@lo:700: 00000100:00100000:0.0:1789117318.998626:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be73480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6693:1876025385430656:0@lo:700: 00000100:00100000:0.0:1789117318.998658:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117318.998722:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788f88f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117318.998800:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385430656 00000100:00100000:3.0:1789117318.998805:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385430656 00000100:00100000:3.0:1789117318.998952:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789117318.998960:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6693:x1876025385430656:12345-0@lo:700: 40000000:02000000:1.0:1789117319.024513:0:5846:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1789117319.030367:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6693:x1876025385430656:12345-0@lo:700: Request processed in 31401us (31701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117319.030386:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789117319.030467:0:6693:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c178be73480 x1876025385430656/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789117334 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117319.030481:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be73480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6693:1876025385430656:0@lo:700: 40000000:02000000:2.0:1789117319.030494:0:6693:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1789117319.087548:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788843c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6994:x1876025385430528:12345-0@lo:700: Request processed in 89152us (89409us total) trans 0 rc 0/0 00010000:00080000:3.0:1789117319.087560:0:6994:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1788840b40 x1876025385430528/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789117334 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117319.087565:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789117319.087575:0:6994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788840b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6994:1876025385430528:0@lo:700: 00000001:00080000:1.0:1789117319.087605:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1789117319.087616:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:3.0:1789117319.111454:0:6994:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1789117319.113812:0:6994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305de00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6994:1876025385430784:0@lo:5: 00000100:00100000:3.0:1789117319.113888:0:6994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117319.113942:0:6994:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1784fb9900 going to sleep for 11 seconds 00000100:00100000:3.0:1789117319.113968:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385430784 00000100:00100000:3.0:1789117319.113973:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385430784 00000100:00100000:3.0:1789117319.114013:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789117319.114020:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179305d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6994:x1876025385430784:12345-0@lo:5: 00002000:00080000:3.0:1789117319.119333:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789117319.119353:0:6687:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1789117319.122296:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179305d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6994:x1876025385430784:12345-0@lo:5: Request processed in 8270us (8401us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789117319.122309:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789117319.122383:0:6994:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c179305de00 x1876025385430784/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789117335 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117319.122396:0:6994:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789117319.122486:0:6994:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9c179305de00 x1876025385430784/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789117335 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117319.122497:0:6994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305de00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6994:1876025385430784:0@lo:5: 00000004:00080000:0.0:1789117319.122518:0:6994:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:02000400:1.0:1789117319.820349:0:7056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg637-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789117320.006852:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117321.029538:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117322.053682:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117323.077485:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117324.102580:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117324.357777:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788841680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385430912:0@lo:400: 00000100:00100000:2.0:1789117324.357905:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117324.357970:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117324.357990:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788842580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385431040:0@lo:400: 00000100:00100000:2.0:1789117324.358023:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117324.358059:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788843840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385431168:0@lo:400: 00000100:00100000:2.0:1789117324.358085:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117324.358107:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117324.358113:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17888412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385431296:0@lo:400: 00000100:00100000:2.0:1789117324.358140:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117324.358279:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385430912 00000100:00100000:2.0:1789117324.358288:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385430912 00000100:00100000:2.0:1789117324.358347:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789117324.358357:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:3300:x1876025385430912:12345-0@lo:400: 00000100:00100000:2.0:1789117324.358447:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:3300:x1876025385430912:12345-0@lo:400: Request processed in 90us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117324.358457:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789117324.358501:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385431040 00000100:00100000:2.0:1789117324.358506:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385431040 00000100:00100000:2.0:1789117324.358541:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385431168 00000100:00100000:2.0:1789117324.358544:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385431168 00000100:00100000:2.0:1789117324.358580:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789117324.358589:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788842d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385431040:12345-0@lo:400: 00000100:00100000:3.0:1789117324.358876:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385431296 00000100:00100000:3.0:1789117324.358883:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385431296 00000100:00100000:3.0:1789117324.359189:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789117324.359201:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788841a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1876025385431296:12345-0@lo:400: 00000100:00100000:3.0:1789117324.359273:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788841a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1876025385431296:12345-0@lo:400: Request processed in 75us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117324.359281:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789117324.359316:0:5839:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789117324.359335:0:5839:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:0.0:1789117324.359570:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c17888412c0 x1876025385431296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117324.359592:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17888412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385431296:0@lo:400: 00000100:00100000:3.0:1789117324.360434:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178beca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385431424:0@lo:13: 00000100:00100000:3.0:1789117324.360495:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789117324.360554:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1788842580 x1876025385431040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117324.360567:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788842580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385431040:0@lo:400: 00000100:00100000:3.0:1789117324.360580:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788841680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385430912:0@lo:400: 00000100:00080000:3.0:1789117324.360772:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789117324.360780:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117324.360806:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789117324.360823:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789117324.360836:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788840b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385431168:12345-0@lo:400: 00010000:00080000:0.0:1789117324.361007:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1788843840 x1876025385431168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117324.361021:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788843840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385431168:0@lo:400: 00000100:00100000:3.0:1789117324.361022:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788840b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385431168:12345-0@lo:400: Request processed in 69us (2815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117324.361246:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789117324.362531:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788842d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385431040:12345-0@lo:400: Request processed in 3937us (4500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117324.362545:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789117324.362873:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385431424 00000100:00100000:2.0:1789117324.362883:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385431424 00000100:00100000:2.0:1789117324.362935:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117324.362993:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179305cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876025385431424:12345-0@lo:13: 00002000:00000024:2.0:1789117324.363031:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789117324.363117:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179305cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876025385431424:12345-0@lo:13: Request processed in 126us (2623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117324.363124:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789117324.363273:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c178beca580 x1876025385431424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117324.363299:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178beca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385431424:0@lo:13: 00000001:00080000:1.0:1789117324.424252:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1789117325.126510:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117326.150930:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117327.173517:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117328.198555:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117329.225699:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117329.479932:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117329.479961:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178bec8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385431552:0@lo:13: 00000100:00100000:3.0:1789117329.480035:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117329.480214:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385431552 00000100:00100000:1.0:1789117329.480222:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385431552 00000100:00100000:1.0:1789117329.480283:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789117329.480293:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179305f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385431552:12345-0@lo:13: 00002000:00000024:1.0:1789117329.480327:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117329.480375:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179305f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385431552:12345-0@lo:13: Request processed in 84us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117329.480382:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789117329.480448:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c178bec8f00 x1876025385431552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117329.480459:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789117329.480480:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178bec8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385431552:0@lo:13: 00000100:00080000:3.0:1789117329.480855:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117329.490964:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178bec8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385431680:0@lo:400: 00000100:00100000:1.0:1789117329.491033:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117329.491082:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117329.491089:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178becbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876025385431808:0@lo:400: 00000100:00100000:1.0:1789117329.491115:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117329.491146:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385431808 00000100:00100000:1.0:1789117329.491153:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385431808 00000100:00100000:0.0:1789117329.491175:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385431680 00000100:00100000:0.0:1789117329.491179:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385431680 00000100:00100000:1.0:1789117329.491192:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789117329.491199:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789117329.491200:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178bec8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876025385431808:12345-0@lo:400: 00000100:00100000:0.0:1789117329.491204:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:3298:x1876025385431680:12345-0@lo:400: 00000100:00100000:2.0:1789117329.491269:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789117329.491279:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178bec9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876025385431936:0@lo:400: 00000100:00100000:2.0:1789117329.491308:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117329.491345:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385431936 00000100:00100000:2.0:1789117329.491348:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385431936 00000100:00100000:2.0:1789117329.491385:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789117329.491391:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876025385431936:12345-0@lo:400: 00000100:00100000:2.0:1789117329.491456:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876025385431936:12345-0@lo:400: Request processed in 52us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117329.491464:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789117329.491505:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c178bec9e00 x1876025385431936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117329.491518:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178bec9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876025385431936:0@lo:400: 00000100:00100000:1.0:1789117329.491813:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178bec8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876025385431808:12345-0@lo:400: Request processed in 612us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117329.491831:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789117329.492978:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117329.498907:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:3298:x1876025385431680:12345-0@lo:400: Request processed in 7692us (7864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117329.498922:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1789117329.500672:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c178becbc00 x1876025385431808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117329.500690:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178becbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876025385431808:0@lo:400: 00000100:00100000:1.0:1789117329.500713:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178bec8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385431680:0@lo:400: 00000020:01000004:2.0:1789117329.942544:0:7632:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789117329.942549:0:7632:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789117329.942692:0:7632:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c16816f2800 00000020:01000004:2.0:1789117329.942707:0:7632:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789117329.942720:0:7632:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789117329.942734:0:7632:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c16816eced8) 00000020:00000080:2.0:1789117329.942751:0:7632:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789117329.960640:0:7632:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789117329.961047:0:7632:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789117329.986535:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789117329.994604:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789117329.994633:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789117329.994685:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789117329.994712:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789117329.995186:0:7632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789117329.995196:0:7632:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789117329.995205:0:7632:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf7565228e460daf8 00000020:01000004:2.0:1789117329.995213:0:7632:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789117329.995234:0:7632:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.137@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789117329.995237:0:7632:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789117329.995243:0:7632:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789117329.995272:0:7632:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789117329.995276:0:7632:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.137@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789117330.012115:0:7632:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.137@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789117330.012146:0:7632:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.137@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789117330.012150:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789117330.012152:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789117330.012153:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789117330.012155:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789117330.012156:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789117330.012157:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789117330.012159:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789117330.012163:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789117330.012164:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789117330.012166:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789117330.012167:0:7632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789117330.012170:0:7632:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789117330.012172:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789117330.012173:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789117330.012174:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789117330.012176:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789117330.012177:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789117330.012178:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789117330.012179:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789117330.012180:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789117330.012181:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789117330.012182:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789117330.012183:0:7632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789117330.012214:0:7632:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789117330.012233:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385432064:0@lo:253: 00000100:00100000:3.0:1789117330.012302:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117330.012433:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17ad14b000 going to sleep for 11 seconds 00000100:00100000:2.0:1789117330.012487:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385432064 00000100:00100000:2.0:1789117330.012494:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385432064 00000100:00100000:2.0:1789117330.012544:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789117330.012554:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:7632:x1876025385432064:12345-0@lo:253: 20000000:01000000:2.0:1789117330.012583:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789117330.012587:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1789117330.012592:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1789117330.012595:0:5834:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1789117330.013916:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789117330.014133:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1789117330.014148:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1789117330.014187:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1789117330.014195:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1789117330.014225:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1789117330.014283:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1789117330.014859:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1789117330.014887:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.137@tcp 20000000:01000000:2.0:1789117330.014889:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.137@tcp (null) (null) (null) 00000040:00080000:2.0:1789117330.014928:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1789117330.014936:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789117330.014985:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1789117330.014993:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.137@tcp (null) (null) 00000040:00080000:2.0:1789117330.015025:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1789117330.015034:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789117330.015061:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1789117330.015105:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1789117330.015969:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1789117330.015990:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.137@tcp 20000000:01000000:2.0:1789117330.015992:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.137@tcp (null) (null) (null) 00000040:00080000:2.0:1789117330.016028:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1789117330.016036:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789117330.016067:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1789117330.016075:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.137@tcp (null) (null) 00000040:00080000:2.0:1789117330.016104:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1789117330.016112:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789117330.016158:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1789117330.016195:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1789117330.016209:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789117330.016212:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789117330.016215:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789117330.016228:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789117330.016230:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789117330.016263:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789117330.016266:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789117330.016943:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1789117330.017010:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1789117330.017047:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1789117330.017260:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1789117330.017302:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1789117330.017369:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1789117330.017382:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789117330.017389:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789117330.018595:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1789117330.018656:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1789117330.018723:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1789117330.018936:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1789117330.018959:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1789117330.018976:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1789117330.018983:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789117330.018985:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789117330.019495:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1789117330.019703:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1789117330.019744:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789117330.019821:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1789117330.019833:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789117330.019835:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789117330.020522:0:7637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1789117330.020571:0:7637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1789117330.020623:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789117330.020875:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789117330.020915:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789117330.020966:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789117330.020980:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1789117330.020982:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1789117330.020990:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789117330.021006:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c178149d600/0xf7565228e460daff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.021021:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c17c2045600/0xf7565228e460da50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460da49 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.021029:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1781685200/0xf7565228e460da7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460da73 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.021035:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1781685400/0xf7565228e460daa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460da9d expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.021047:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178149cc00/0xf7565228e460dac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dab9 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.021054:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c17c2044800/0xf7565228e460daea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dae3 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.021061:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c178149d600/0xf7565228e460daff lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.021094:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c17c2044800/0xf7565228e460daea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460dae3 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.021105:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c17c2044800/0xf7565228e460daea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460dae3 expref: 16 pid: 5835 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117330.021119:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305de00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876025385432192:0@lo:104: 00000100:00100000:3.0:1789117330.021180:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117330.021243:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178149cc00/0xf7565228e460dac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460dab9 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.021252:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c178149cc00/0xf7565228e460dac0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460dab9 expref: 16 pid: 5834 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117330.021261:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86ab840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876025385432320:0@lo:104: 00010000:00010000:3.0:1789117330.021289:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1781685400/0xf7565228e460daa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460da9d expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.021296:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1781685400/0xf7565228e460daa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460da9d expref: 16 pid: 5834 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117330.021316:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86aa580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876025385432448:0@lo:104: 00010000:00010000:3.0:1789117330.021338:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1781685200/0xf7565228e460da7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460da73 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.021345:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1781685200/0xf7565228e460da7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460da73 expref: 16 pid: 5835 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117330.021351:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86aa1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876025385432576:0@lo:104: 00010000:00010000:3.0:1789117330.021377:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c17c2045600/0xf7565228e460da50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460da49 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.021384:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c17c2045600/0xf7565228e460da50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460da49 expref: 16 pid: 5833 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117330.021391:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86ab0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876025385432704:0@lo:104: 00000100:00100000:3.0:1789117330.021438:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c061b000 going to sleep for 11 seconds 00000100:00100000:2.0:1789117330.021612:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789117330.021631:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117330.021701:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117330.024567:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117330.025132:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385432192 00000100:00100000:0.0:1789117330.025142:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385432192 00000100:00100000:2.0:1789117330.025156:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117330.025188:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385432320 00000100:00100000:0.0:1789117330.025192:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385432320 00000100:00100000:0.0:1789117330.025202:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385432448 00000100:00100000:0.0:1789117330.025204:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385432448 00000100:00100000:0.0:1789117330.025214:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385432576 00000100:00100000:0.0:1789117330.025216:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385432576 00000100:00100000:0.0:1789117330.025245:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385432704 00000100:00100000:0.0:1789117330.025248:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385432704 00000100:00100000:0.0:1789117330.025262:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789117330.025273:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178300a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+7:5834:x1876025385432192:12345-0@lo:104: 00010000:00010000:0.0:1789117330.025290:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c17c2045800/0xf7565228e460dae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460daea expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.025420:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789117330.025426:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178300a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+7:5834:x1876025385432192:12345-0@lo:104: Request processed in 156us (4246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117330.025434:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789117330.025477:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789117330.025485:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788843840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+6:5834:x1876025385432320:12345-0@lo:104: 00010000:00010000:0.0:1789117330.025493:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c1780030200/0xf7565228e460dab9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dac0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.025566:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789117330.025572:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788843840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+6:5834:x1876025385432320:12345-0@lo:104: Request processed in 90us (3941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117330.025578:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789117330.025590:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789117330.025596:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788841680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+5:5834:x1876025385432448:12345-0@lo:104: 00010000:00010000:0.0:1789117330.025603:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c1780030400/0xf7565228e460da9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460daa4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117330.025891:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305de00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876025385432192:0@lo:104: 00000100:00100000:3.0:1789117330.025901:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86ab840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876025385432320:0@lo:104: 00000100:00100000:3.0:1789117330.025907:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86aa580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876025385432448:0@lo:104: 00010000:00010000:2.0:1789117330.025936:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789117330.025942:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c17c2045800/0xf7565228e460dae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460daea expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.025949:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2045800 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:2.0:1789117330.025953:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c17c2045800/0xf7565228e460dae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460daea expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.025960:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c17c2045800/0xf7565228e460dae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460daea expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117330.025967:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c17c2045800/0xf7565228e460dae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460daea expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117330.025984:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789117330.026026:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c17c2045800/0xf7565228e460dae3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460daea expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.026033:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117330.026048:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c17c2045800/0xf7565228e460dae3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460daea expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.026054:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c17c2045800/0xf7565228e460dae3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460daea expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.026066:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789117330.026069:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c1780030200/0xf7565228e460dab9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dac0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.026074:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1780030200 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:2.0:1789117330.026076:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c1780030200/0xf7565228e460dab9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460dac0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.026082:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c1780030200/0xf7565228e460dab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460dac0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117330.026087:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c1780030200/0xf7565228e460dab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460dac0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117330.026092:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789117330.026102:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c1780030200/0xf7565228e460dab9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dac0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.026107:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117330.026127:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c1780030200/0xf7565228e460dab9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dac0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.026133:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c1780030200/0xf7565228e460dab9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dac0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.026144:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117330.026146:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c1780030400/0xf7565228e460da9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460daa4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.026151:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1780030400 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:2.0:1789117330.026154:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c1780030400/0xf7565228e460da9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460daa4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.026160:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c1780030400/0xf7565228e460da9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460daa4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117330.026166:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c1780030400/0xf7565228e460da9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460daa4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117330.026171:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789117330.026197:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c1780030400/0xf7565228e460da9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460daa4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.026202:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117330.026207:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c1780030400/0xf7565228e460da9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460daa4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.026213:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c1780030400/0xf7565228e460da9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460daa4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.026222:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117330.026229:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117330.026231:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117330.026244:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17888403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385432832:0@lo:103: 00000100:00100000:2.0:1789117330.026283:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117330.026329:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385433088:0@lo:103: 00000100:00100000:2.0:1789117330.026351:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117330.026366:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117330.026371:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179198c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385432960:0@lo:103: 00000100:00100000:2.0:1789117330.026389:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117330.026483:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1789117330.026490:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788841680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+5:5834:x1876025385432448:12345-0@lo:104: Request processed in 894us (4788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117330.026506:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789117330.026524:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789117330.026532:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788842580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+4:5834:x1876025385432576:12345-0@lo:104: 00010000:00010000:0.0:1789117330.026540:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460da7a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117330.026675:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385432832 00000100:00100000:3.0:1789117330.026680:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385432832 00010000:00010000:3.0:1789117330.026702:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c17c2044800/0xf7565228e460daea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dae3 expref: 17 pid: 5835 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117330.026716:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385433088 00000100:00100000:3.0:1789117330.026718:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385433088 00010000:00010000:3.0:1789117330.026725:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1781685400/0xf7565228e460daa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460da9d expref: 18 pid: 5834 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117330.026741:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385432960 00000100:00100000:3.0:1789117330.026743:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385432960 00010000:00010000:3.0:1789117330.026751:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178149cc00/0xf7565228e460dac0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dab9 expref: 19 pid: 5834 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117330.026775:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789117330.026781:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3301:x1876025385432832:12345-0@lo:103: 00010000:00010000:3.0:1789117330.026790:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117330.026795:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c17c2044800/0xf7565228e460daea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dae3 expref: 19 pid: 5835 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.026804:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c17c2044800/0xf7565228e460daea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460dae3 expref: 19 pid: 5835 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.026817:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c17c2044800/0xf7565228e460daea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460dae3 expref: 19 pid: 5835 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.026829:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789117330.027173:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117330.027211:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789117330.027217:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788842580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+4:5834:x1876025385432576:12345-0@lo:104: Request processed in 687us (2658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117330.027225:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789117330.027242:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789117330.027250:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17888412c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:5834:x1876025385432704:12345-0@lo:104: 00010000:00010000:0.0:1789117330.027259:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460da49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460da50 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117330.027299:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86aa1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876025385432576:0@lo:104: 00010000:00010000:0.0:1789117330.027524:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789117330.027528:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86ab0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876025385432704:0@lo:104: 00000100:00100000:0.0:1789117330.027530:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17888412c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:5834:x1876025385432704:12345-0@lo:104: Request processed in 283us (2376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117330.027536:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789117330.027555:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1789117330.027558:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c178149d600/0xf7565228e460daff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117330.027561:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789117330.027574:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789117330.027581:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789117330.027588:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:3299:x1876025385433088:12345-0@lo:103: 00010000:00010000:0.0:1789117330.027596:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117330.027601:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1781685400/0xf7565228e460daa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460da9d expref: 18 pid: 5834 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.027630:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1781685400/0xf7565228e460daa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460da9d expref: 18 pid: 5834 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.027641:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1781685400/0xf7565228e460daa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460da9d expref: 18 pid: 5834 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117330.027642:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:3301:x1876025385432832:12345-0@lo:103: Request processed in 861us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117330.027648:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789117330.027654:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117330.027662:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789117330.027667:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789117330.027673:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:3299:x1876025385432960:12345-0@lo:103: 00000100:00100000:0.0:1789117330.027675:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:3299:x1876025385433088:12345-0@lo:103: Request processed in 90us (1324us total) trans 0 rc 0/0 00010000:00010000:3.0:1789117330.027680:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789117330.027681:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1789117330.027684:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178149cc00/0xf7565228e460dac0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dab9 expref: 16 pid: 5834 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.027695:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789117330.027700:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460da7a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.027703:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178149cc00/0xf7565228e460dac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460dab9 expref: 15 pid: 5834 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.027713:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2044c00 already unused, calling callback (ffffffffc1ce7c20) 00010000:00010000:3.0:1789117330.027714:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178149cc00/0xf7565228e460dac0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460dab9 expref: 15 pid: 5834 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117330.027717:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460da7a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.027723:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117330.027724:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460da7a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117330.027731:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460da7a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117330.027736:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789117330.027745:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:3299:x1876025385432960:12345-0@lo:103: Request processed in 72us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117330.027751:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789117330.027821:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17888403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385432832:0@lo:103: 00010000:00010000:0.0:1789117330.027876:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460da7a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.027882:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789117330.027928:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1789117330.027972:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460da7a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.027979:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c17c2044c00/0xf7565228e460da73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460da7a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.027990:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117330.027993:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460da49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460da50 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.027998:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178149c800 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:0.0:1789117330.028001:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460da49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460da50 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.028007:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460da49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460da50 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117330.028013:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460da49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460da50 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117330.028019:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789117330.028032:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460da49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460da50 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.028038:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789117330.028047:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179198c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385432960:0@lo:103: 00000100:00100000:2.0:1789117330.028056:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385433088:0@lo:103: 00000100:00100000:1.0:1789117330.028102:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385433344:0@lo:103: 00000100:00100000:1.0:1789117330.028133:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117330.028164:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385433216:0@lo:103: 00000100:00100000:1.0:1789117330.028185:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117330.028231:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460da49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460da50 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.028238:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460da49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460da50 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.028252:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117330.028258:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117330.028260:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117330.028271:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117330.028343:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385433344 00000100:00100000:2.0:1789117330.028349:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385433344 00010000:00010000:2.0:1789117330.028368:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c17c2045600/0xf7565228e460da50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460da49 expref: 14 pid: 5833 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117330.028381:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385433216 00000100:00100000:2.0:1789117330.028383:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385433216 00010000:00010000:2.0:1789117330.028393:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1781685200/0xf7565228e460da7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460da73 expref: 15 pid: 5835 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117330.028425:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789117330.028432:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178bec8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:3301:x1876025385433344:12345-0@lo:103: 00010000:00010000:2.0:1789117330.028439:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117330.028443:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c17c2045600/0xf7565228e460da50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460da49 expref: 15 pid: 5833 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.028451:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c17c2045600/0xf7565228e460da50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460da49 expref: 15 pid: 5833 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.028529:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c17c2045600/0xf7565228e460da50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460da49 expref: 15 pid: 5833 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.028539:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117330.028575:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178bec8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:3301:x1876025385433344:12345-0@lo:103: Request processed in 144us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117330.028582:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789117330.028601:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789117330.028607:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178becbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:3301:x1876025385433216:12345-0@lo:103: 00010000:00010000:2.0:1789117330.028614:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789117330.028615:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385433344:0@lo:103: 00010000:00010000:2.0:1789117330.028618:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1781685200/0xf7565228e460da7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460da73 expref: 13 pid: 5835 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.028627:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1781685200/0xf7565228e460da7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460da73 expref: 13 pid: 5835 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.028637:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1781685200/0xf7565228e460da7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460da73 expref: 13 pid: 5835 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.028648:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c178149d600/0xf7565228e460daff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.028655:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178149d600/0xf7565228e460daff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.028668:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178149d600/0xf7565228e460daff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.028675:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178149d600/0xf7565228e460daff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.028686:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c178149d600/0xf7565228e460daff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.028693:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c178149d600/0xf7565228e460daff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.028699:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178149d600 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117330.028703:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c178149d600/0xf7565228e460daff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.028710:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c178149d600/0xf7565228e460daff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.028728:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c178149d600/0xf7565228e460daff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.028738:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117330.028776:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178becbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:3301:x1876025385433216:12345-0@lo:103: Request processed in 156us (577us total) trans 0 rc 0/0 00010000:00010000:3.0:1789117330.028777:0:5834:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c178149d600/0xf7565228e460daff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117330.028783:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789117330.028785:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c178149d600/0xf7565228e460daff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.028791:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178149d600/0xf7565228e460daff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789117330.028804:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789117330.028928:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385433216:0@lo:103: 00000100:00100000:1.0:1789117330.068114:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:7632:x1876025385432064:12345-0@lo:253: Request processed in 55551us (55800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117330.068128:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789117330.068266:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385432064:0@lo:253: 10000000:01000000:3.0:1789117330.068282:0:7632:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789117330.068285:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789117330.068287:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789117330.068288:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789117330.068289:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789117330.068291:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789117330.068292:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789117330.068294:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789117330.068295:0:7632:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789117330.068297:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789117330.068310:0:7632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789117330.068330:0:7632:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c16816f2800 from lustre-OST0001 10000000:01000000:3.0:1789117330.068352:0:7632:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789117330.068355:0:7632:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789117330.068361:0:7632:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c17882d4ed8 local copy 10000000:01000000:3.0:1789117330.068365:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789117330.068419:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149d600/0xf7565228e460db06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.068430:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.137@tcp lock: ffff9c178149d600/0xf7565228e460db06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.068520:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178149d600/0xf7565228e460db06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117330.068540:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385433472:0@lo:101: 00000100:00100000:3.0:1789117330.068574:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117330.068668:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c061b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789117330.068772:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385433472 00000100:00100000:0.0:1789117330.068779:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385433472 00000100:00100000:0.0:1789117330.068860:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789117330.068870:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+11:7632:x1876025385433472:12345-0@lo:101: 00010000:00010000:0.0:1789117330.068883:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117330.068896:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1780031000/0xf7565228e460db0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460db06 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.068918:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1780031000/0xf7565228e460db0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460db06 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.068928:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1780031000/0xf7565228e460db0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460db06 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.068938:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1780031000, rc 0) 00000100:00100000:0.0:1789117330.068977:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:7632:x1876025385433472:12345-0@lo:101: Request processed in 108us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117330.068983:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789117330.069045:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385433472:0@lo:101: 00010000:00010000:3.0:1789117330.069058:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178149d600/0xf7565228e460db06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf7565228e460db0d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.069067:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178149d600/0xf7565228e460db06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf7565228e460db0d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117330.069164:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385433600:0@lo:501: 00000100:00100000:3.0:1789117330.069189:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117330.069252:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c061b300 going to sleep for 11 seconds 00000100:00100000:2.0:1789117330.069375:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385433600 00000100:00100000:2.0:1789117330.069379:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385433600 00000100:00100000:2.0:1789117330.069429:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789117330.069436:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:7632:x1876025385433600:12345-0@lo:501: 00000100:00100000:2.0:1789117330.069627:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:7632:x1876025385433600:12345-0@lo:501: Request processed in 191us (436us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789117330.069635:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789117330.069801:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385433600:0@lo:501: 10000000:01000000:3.0:1789117330.069816:0:7632:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789117330.069850:0:7632:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789117330.069856:0:7632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149d600/0xf7565228e460db06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf7565228e460db0d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.069864:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149d600/0xf7565228e460db06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf7565228e460db0d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.069872:0:7632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.137@tcp lock: ffff9c178149d600/0xf7565228e460db06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf7565228e460db0d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.069895:0:7632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789117330.069913:0:7632:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c16816f2800 10000000:01000000:3.0:1789117330.069918:0:7632:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789117330.069924:0:7632:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789117330.069926:0:7632:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789117330.069931:0:7632:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789117330.069935:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789117330.069936:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117330.069944:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c178149d600/0xf7565228e460db06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf7565228e460db0d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.069955:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149cc00/0xf7565228e460db14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.069964:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178149cc00/0xf7565228e460db14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.069964:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178149d600 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:0.0:1789117330.069972:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c178149d600/0xf7565228e460db06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xf7565228e460db0d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.069978:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178149cc00/0xf7565228e460db14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.070002:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178149d600/0xf7565228e460db06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf7565228e460db0d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117330.070007:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385433728:0@lo:101: 10000000:00010000:0.0:1789117330.070015:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178149d600/0xf7565228e460db06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf7565228e460db0d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117330.070023:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789117330.070043:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117330.070047:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c178149d600/0xf7565228e460db06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7565228e460db0d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.070055:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117330.070074:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c178149d600/0xf7565228e460db06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7565228e460db0d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.070081:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178149d600/0xf7565228e460db06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7565228e460db0d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.070094:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117330.070095:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117330.070097:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117330.070172:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117330.070184:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385433856:0@lo:103: 00000100:00100000:2.0:1789117330.070224:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117330.070238:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385433728 00000100:00100000:1.0:1789117330.070245:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385433728 00000100:00100000:1.0:1789117330.070282:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789117330.070291:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:7632:x1876025385433728:12345-0@lo:101: 00010000:00010000:1.0:1789117330.070301:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117330.070313:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1781685600/0xf7565228e460db1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460db14 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117330.070315:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a9764540 going to sleep for 11 seconds 00010000:00010000:1.0:1789117330.070333:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1781685600/0xf7565228e460db1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460db14 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117330.070480:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385433856 00000100:00100000:0.0:1789117330.070485:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385433856 00000100:00100000:0.0:1789117330.070529:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789117330.070537:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:3299:x1876025385433856:12345-0@lo:103: 00010000:00010000:0.0:1789117330.070546:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117330.070559:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1780031000/0xf7565228e460db0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7565228e460db06 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.070571:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117330.070621:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:3299:x1876025385433856:12345-0@lo:103: Request processed in 84us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117330.070628:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117330.070660:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385433856:0@lo:103: 00010000:00010000:1.0:1789117330.070692:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1781685600/0xf7565228e460db1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460db14 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117330.070702:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685600, rc 0) 00000100:00100000:1.0:1789117330.070740:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:7632:x1876025385433728:12345-0@lo:101: Request processed in 449us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117330.070747:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789117330.070931:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385433728:0@lo:101: 00010000:00010000:3.0:1789117330.070951:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178149cc00/0xf7565228e460db14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db1b expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.070960:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178149cc00/0xf7565228e460db14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460db1b expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117330.071038:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385433984:0@lo:501: 00000100:00100000:3.0:1789117330.071204:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117330.071271:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a9764540 going to sleep for 11 seconds 00000100:00100000:2.0:1789117330.071313:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385433984 00000100:00100000:2.0:1789117330.071317:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385433984 00000100:00100000:2.0:1789117330.071356:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789117330.071364:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:7632:x1876025385433984:12345-0@lo:501: 00000100:00100000:2.0:1789117330.071708:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:7632:x1876025385433984:12345-0@lo:501: Request processed in 343us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117330.071715:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789117330.071854:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385433984:0@lo:501: 00000100:00100000:3.0:1789117330.071885:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385434112:0@lo:503: 00000100:00100000:3.0:1789117330.071926:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117330.071962:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a9764540 going to sleep for 11 seconds 00000100:00100000:1.0:1789117330.072030:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385434112 00000100:00100000:1.0:1789117330.072034:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385434112 00000100:00100000:1.0:1789117330.072178:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789117330.072187:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:7632:x1876025385434112:12345-0@lo:503: 00000100:00100000:1.0:1789117330.072338:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:7632:x1876025385434112:12345-0@lo:503: Request processed in 151us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117330.072345:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789117330.072460:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385434112:0@lo:503: 00000040:00080000:3.0:1789117330.072691:0:7632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789117330.072747:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385434240:0@lo:502: 00000100:00100000:3.0:1789117330.072804:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117330.072821:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385434240 00000100:00100000:0.0:1789117330.072827:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385434240 00000100:00100000:3.0:1789117330.072830:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788711180 going to sleep for 11 seconds 00000100:00100000:0.0:1789117330.072856:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789117330.072864:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:7632:x1876025385434240:12345-0@lo:502: 00000100:00100000:0.0:1789117330.073008:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:7632:x1876025385434240:12345-0@lo:502: Request processed in 145us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117330.073016:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789117330.073038:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385434240:0@lo:502: 00000040:00080000:3.0:1789117330.073355:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789117330.073518:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789117330.073544:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789117330.073572:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789117330.073592:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789117330.073608:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789117330.073626:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385434368:0@lo:502: 00000100:00100000:3.0:1789117330.073662:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117330.073729:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a9764540 going to sleep for 11 seconds 00000100:00100000:2.0:1789117330.073802:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385434368 00000100:00100000:2.0:1789117330.073808:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385434368 00000100:00100000:2.0:1789117330.073844:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789117330.073852:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:7632:x1876025385434368:12345-0@lo:502: 00000100:00100000:2.0:1789117330.073990:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:7632:x1876025385434368:12345-0@lo:502: Request processed in 138us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117330.073997:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789117330.074006:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385434368:0@lo:502: 00000040:00080000:3.0:1789117330.074160:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789117330.074171:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789117330.074798:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789117330.074806:0:7640:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789117330.074812:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117330.074814:0:7640:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789117330.074819:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789117330.074831:0:7640:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c17c1c63490) 00000020:00000080:3.0:1789117330.074862:0:7640:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789117330.074869:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789117330.074927:0:7640:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c16816f2800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789117330.074936:0:7640:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789117330.074942:0:7640:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf7565228e460db29 00010000:00010000:3.0:1789117330.078588:0:7640:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1789117330.078884:0:7640:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789117330.083614:0:7640:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789117330.083899:0:7640:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789117330.087898:0:7640:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789117330.088677:0:7640:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789117330.090542:0:7640:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789117330.090554:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117330.090560:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117330.090562:0:7640:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789117330.090565:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117330.090569:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117330.090570:0:7640:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789117330.090573:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789117330.090575:0:7640:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789117330.090608:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117330.090616:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117330.090618:0:7640:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789117330.090621:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789117330.091039:0:7632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789117330.091063:0:7632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789117330.091096:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149cc00/0xf7565228e460db14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db1b expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.091107:0:7632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178149cc00/0xf7565228e460db14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db1b expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117330.091115:0:7632:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c16816f2800 from 1 10000000:01000000:3.0:1789117330.091119:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789117330.091162:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149c200/0xf7565228e460db30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.091170:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178149c200/0xf7565228e460db30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.091180:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178149c200/0xf7565228e460db30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117330.091203:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385434496:0@lo:101: 00000100:00100000:3.0:1789117330.091268:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117330.091566:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17882bf240 going to sleep for 11 seconds 00000100:00100000:2.0:1789117330.091696:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385434496 00000100:00100000:2.0:1789117330.091704:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385434496 00000100:00100000:2.0:1789117330.091741:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789117330.091751:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:7632:x1876025385434496:12345-0@lo:101: 00010000:00010000:2.0:1789117330.091777:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117330.091790:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178457f600/0xf7565228e460db37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460db30 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.091812:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178457f600/0xf7565228e460db37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460db30 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.091821:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178457f600/0xf7565228e460db37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460db30 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.091829:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f600, rc 0) 00000100:00100000:2.0:1789117330.091871:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:7632:x1876025385434496:12345-0@lo:101: Request processed in 122us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117330.091877:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789117330.092288:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385434496:0@lo:101: 00010000:00010000:3.0:1789117330.092313:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178149c200/0xf7565228e460db30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db37 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.092322:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178149c200/0xf7565228e460db30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460db37 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117330.092437:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385434624:0@lo:501: 00000100:00100000:3.0:1789117330.092477:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117330.092495:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17882bf240 going to sleep for 11 seconds 00000100:00100000:2.0:1789117330.092668:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385434624 00000100:00100000:2.0:1789117330.092673:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385434624 00000100:00100000:2.0:1789117330.092694:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789117330.092700:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:7632:x1876025385434624:12345-0@lo:501: 00000100:00100000:2.0:1789117330.093019:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:7632:x1876025385434624:12345-0@lo:501: Request processed in 317us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117330.093026:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789117330.093341:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385434624:0@lo:501: 00000100:00100000:3.0:1789117330.093368:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385434752:0@lo:503: 00000100:00100000:3.0:1789117330.093437:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117330.093757:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17882bf240 going to sleep for 11 seconds 00000100:00100000:1.0:1789117330.093873:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385434752 00000100:00100000:1.0:1789117330.093886:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385434752 00000100:00100000:1.0:1789117330.093918:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789117330.093926:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:7632:x1876025385434752:12345-0@lo:503: 00000100:00100000:1.0:1789117330.094248:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:7632:x1876025385434752:12345-0@lo:503: Request processed in 321us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117330.094255:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789117330.094666:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385434752:0@lo:503: 00000040:00080000:3.0:1789117330.094917:0:7632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789117330.094979:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385434880:0@lo:502: 00000100:00100000:3.0:1789117330.095019:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117330.096223:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17882bf240 going to sleep for 11 seconds 00000100:00100000:2.0:1789117330.098910:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385434880 00000100:00100000:2.0:1789117330.098926:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385434880 00000100:00100000:2.0:1789117330.098973:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789117330.098981:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:7632:x1876025385434880:12345-0@lo:502: 00000100:00100000:2.0:1789117330.100579:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:7632:x1876025385434880:12345-0@lo:502: Request processed in 1593us (5554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117330.100590:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789117330.100705:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385434880:0@lo:502: 00000040:00080000:0.0:1789117330.100976:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789117330.101031:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789117330.101067:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be70f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385435008:0@lo:502: 00000100:00100000:0.0:1789117330.102200:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117330.102285:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a0318900 going to sleep for 11 seconds 00000100:00100000:1.0:1789117330.108435:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385435008 00000100:00100000:1.0:1789117330.108448:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385435008 00000100:00100000:1.0:1789117330.108500:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789117330.108507:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:7632:x1876025385435008:12345-0@lo:502: 00000100:00100000:1.0:1789117330.108755:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:7632:x1876025385435008:12345-0@lo:502: Request processed in 246us (6555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117330.108776:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789117330.108814:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be70f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385435008:0@lo:502: 00000040:00080000:3.0:1789117330.108961:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789117330.108974:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789117330.109848:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117330.109861:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117330.109863:0:7644:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789117330.109870:0:7644:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c16816f2800 00000020:00000080:1.0:1789117330.109873:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789117330.109891:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117330.109894:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117330.109895:0:7644:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789117330.109898:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789117330.109948:0:7632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789117330.109965:0:7632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117330.109984:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149c200/0xf7565228e460db30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db37 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.109993:0:7632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178149c200/0xf7565228e460db30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db37 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117330.110021:0:7632:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789117330.110023:0:7632:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c16816f2800 10000000:01000000:3.0:1789117330.110025:0:7632:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c16816f2800 10000000:01000000:3.0:1789117330.110028:0:7632:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789117330.110031:0:7632:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c16816f2800 from 1 10000000:01000000:3.0:1789117330.110033:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789117330.110058:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149d800/0xf7565228e460db3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.110064:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178149d800/0xf7565228e460db3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117330.110071:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178149d800/0xf7565228e460db3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117330.110138:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86abc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385435136:0@lo:101: 00000100:00100000:3.0:1789117330.110191:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117330.110220:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17882bfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789117330.110235:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385435136 00000100:00100000:2.0:1789117330.110242:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385435136 00000100:00100000:2.0:1789117330.110290:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789117330.110307:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:7632:x1876025385435136:12345-0@lo:101: 00010000:00010000:2.0:1789117330.110319:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117330.110333:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178457e200/0xf7565228e460db45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460db3e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.110355:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178457e200/0xf7565228e460db45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460db3e expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.110365:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178457e200/0xf7565228e460db45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460db3e expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.110373:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457e200, rc 0) 00000100:00100000:3.0:1789117330.110447:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86abc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385435136:0@lo:101: 00000100:00100000:2.0:1789117330.110453:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:7632:x1876025385435136:12345-0@lo:101: Request processed in 142us (249us total) trans 0 rc 0/0 00010000:00010000:3.0:1789117330.110460:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178149d800/0xf7565228e460db3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db45 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117330.110465:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00010000:3.0:1789117330.110472:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178149d800/0xf7565228e460db3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460db45 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117330.110540:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86abc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385435264:0@lo:501: 00000100:00100000:3.0:1789117330.110558:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117330.110585:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17882bfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789117330.110621:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385435264 00000100:00100000:2.0:1789117330.110625:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385435264 00000100:00100000:2.0:1789117330.110662:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789117330.110669:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:7632:x1876025385435264:12345-0@lo:501: 00000100:00100000:2.0:1789117330.110917:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:7632:x1876025385435264:12345-0@lo:501: Request processed in 248us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117330.110931:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789117330.110993:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86abc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385435264:0@lo:501: 00000100:00100000:0.0:1789117330.111021:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be70b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385435392:0@lo:503: 00000100:00100000:0.0:1789117330.111058:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117330.111091:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a0318600 going to sleep for 11 seconds 00000100:00100000:2.0:1789117330.111313:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385435392 00000100:00100000:2.0:1789117330.111319:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385435392 00000100:00100000:2.0:1789117330.111337:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789117330.111343:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:7632:x1876025385435392:12345-0@lo:503: 00000100:00100000:2.0:1789117330.111636:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:7632:x1876025385435392:12345-0@lo:503: Request processed in 291us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117330.111643:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789117330.111720:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be70b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385435392:0@lo:503: 00000040:00080000:0.0:1789117330.112023:0:7632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789117330.112074:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be70b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385435520:0@lo:502: 00000100:00100000:0.0:1789117330.112237:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117330.112269:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a0318600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117330.112430:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385435520 00000100:00100000:1.0:1789117330.112435:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385435520 00000100:00100000:1.0:1789117330.112638:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789117330.112647:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:7632:x1876025385435520:12345-0@lo:502: 00000100:00100000:1.0:1789117330.112953:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:7632:x1876025385435520:12345-0@lo:502: Request processed in 306us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117330.112960:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789117330.113028:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be70b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385435520:0@lo:502: 00000040:00080000:0.0:1789117330.113438:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789117330.113637:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789117330.113679:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789117330.113775:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789117330.113817:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789117330.113871:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789117330.113995:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789117330.114031:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789117330.114156:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789117330.114197:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789117330.114232:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789117330.114280:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789117330.114391:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789117330.114572:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789117330.114623:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789117330.114659:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789117330.114693:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789117330.114759:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789117330.114813:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789117330.114850:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789117330.115062:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789117330.115180:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789117330.115233:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789117330.115277:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789117330.115386:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789117330.115712:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789117330.115811:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789117330.115860:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1789117330.115985:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789117330.116039:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1789117330.116077:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1789117330.116639:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1789117330.116694:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1789117330.116749:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1789117330.116801:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1789117330.116851:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1789117330.116903:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1789117330.116952:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be70b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385435648:0@lo:502: 00000100:00100000:0.0:1789117330.117020:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117330.117070:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a0318600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117330.117190:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385435648 00000100:00100000:1.0:1789117330.117197:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385435648 00000100:00100000:1.0:1789117330.117247:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789117330.117255:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:7632:x1876025385435648:12345-0@lo:502: 00000100:00100000:1.0:1789117330.117669:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:7632:x1876025385435648:12345-0@lo:502: Request processed in 412us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117330.117676:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789117330.117753:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be70b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385435648:0@lo:502: 00000040:00080000:0.0:1789117330.117829:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1789117330.117840:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1789117330.118601:0:7645:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789117330.118616:0:7645:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c1788298000) 00000020:00000080:0.0:1789117330.118636:0:7645:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1789117330.118694:0:7645:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c16816f2800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789117330.118697:0:7645:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c16816f2800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789117330.118700:0:7645:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c16816f2800 3 00010000:00080000:0.0:1789117330.118735:0:7645:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c16822fd800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.137@tcp at head 00010000:00010000:0.0:1789117330.120807:0:7645:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1789117330.120991:0:7645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789117330.121025:0:7645:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789117330.121036:0:7645:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf7565228e460db53 00000100:00080000:0.0:1789117330.121044:0:7645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789117330.121063:0:7645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c16822fd800 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:0.0:1789117330.121096:0:7645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c178be70b40 x1876025385435776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789117330.121122:0:7645:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789117330.121382:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876025385435776:0@lo:38: 00000100:00100000:1.0:1789117330.121388:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178bec8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876025385435904:0@lo:400: 00000100:00100000:0.0:1789117330.121483:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178beca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385436160:0@lo:400: 00000100:00100000:3.0:1789117330.122049:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117330.122165:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117330.122206:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178becb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385436032:0@lo:400: 00000100:00100000:1.0:1789117330.122232:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117330.122263:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385435776 00000100:00100000:1.0:1789117330.122269:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385435776 00000100:00100000:3.0:1789117330.122499:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385435904 00000100:00100000:3.0:1789117330.122504:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385435904 00000100:00100000:3.0:1789117330.122529:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385436032 00000100:00100000:3.0:1789117330.122531:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385436032 00000100:00100000:3.0:1789117330.122546:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789117330.122554:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178bec9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876025385435904:12345-0@lo:400: 00000100:00100000:3.0:1789117330.122608:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178bec9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876025385435904:12345-0@lo:400: Request processed in 54us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117330.122615:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789117330.122630:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789117330.122636:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17888403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385436032:12345-0@lo:400: 00000100:00100000:3.0:1789117330.122667:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17888403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385436032:12345-0@lo:400: Request processed in 31us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117330.122682:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789117330.122695:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789117330.122698:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876025385435776:12345-0@lo:38: 00010000:00080000:3.0:1789117330.122730:0:5839:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:3.0:1789117330.122761:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf7565228e460db5a 00000004:00100000:3.0:1789117330.122791:0:5839:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789117330.122820:0:5839:0:(import.c:65:import_set_state_nolock()) ffff9c17b86da800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789117330.122869:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1876025385435776:12345-0@lo:38: Request processed in 169us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117330.122876:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789117330.122968:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c178becb480 x1876025385436032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117330.122980:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178becb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385436032:0@lo:400: 00010000:00080000:1.0:1789117330.123120:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c178bec8780 x1876025385435904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117330.123129:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178bec8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876025385435904:0@lo:400: 00010000:00080000:2.0:1789117330.123275:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c178be70b40 x1876025385435776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789117340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117330.123284:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789117330.123290:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789117330.123357:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789117330.123362:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789117330.123365:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c16822fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789117330.123371:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876025385435776:0@lo:38: 00000100:00100000:2.0:1789117330.123579:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b0b40 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7647:1876025385436288:0@lo:901: 00000100:00100000:2.0:1789117330.123612:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1789117330.123622:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1789117330.123642:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385436288 00000100:00100000:2.0:1789117330.123646:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385436288 00000020:01000000:3.0:1789117330.123665:0:7632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789117330.123686:0:7632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:2.0:1789117330.123697:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789117330.123698:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149d800/0xf7565228e460db3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db45 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117330.123705:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7647:x1876025385436288:12345-0@lo:901: 00010000:00010000:3.0:1789117330.123709:0:7632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178149d800/0xf7565228e460db3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db45 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789117330.123748:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789117330.123750:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789117330.123751:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789117330.123752:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789117330.123754:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789117330.123755:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789117330.123756:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789117330.123758:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789117330.123759:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789117330.123761:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789117330.123762:0:7632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789117330.123783:0:7632:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789117330.123785:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789117330.123786:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789117330.123787:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789117330.123788:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789117330.123789:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789117330.123789:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789117330.123790:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789117330.123791:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789117330.123792:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789117330.123793:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789117330.123794:0:7632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789117330.123806:0:7632:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789117330.123812:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385436416:0@lo:253: 00000100:00100000:3.0:1789117330.123845:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117330.123872:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17882bf240 going to sleep for 11 seconds 00000100:00100000:1.0:1789117330.123988:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385436416 00000100:00100000:1.0:1789117330.123993:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385436416 00000100:00100000:1.0:1789117330.124025:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789117330.124031:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:7632:x1876025385436416:12345-0@lo:253: 20000000:01000000:1.0:1789117330.124062:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789117330.124076:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789117330.124116:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7647:x1876025385436288:12345-0@lo:901: Request processed in 412us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117330.124123:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789117330.124164:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117330.124172:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c0ce0b40 going to sleep for 11 seconds 00010000:00080000:2.0:1789117330.124189:0:7647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c17b86b0b40 x1876025385436288/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789117346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117330.124199:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b0b40 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7647:1876025385436288:0@lo:901: 00000100:00100000:0.0:1789117330.124579:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117330.124733:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385436160 00000100:00100000:2.0:1789117330.124738:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385436160 00000100:00100000:2.0:1789117330.124823:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117330.124831:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385436160:12345-0@lo:400: 00000100:00100000:2.0:1789117330.124873:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385436160:12345-0@lo:400: Request processed in 43us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117330.124879:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789117330.125029:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c178beca580 x1876025385436160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117330.125039:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178beca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385436160:0@lo:400: 20000000:01000000:3.0:1789117330.153832:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789117330.153883:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789117330.153967:0:5855:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789117330.153972:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789117330.153992:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c1780031000/0xf7565228e460db61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.154009:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1781685000/0xf7565228e460dab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460daab expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.154017:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c1780031000/0xf7565228e460db61 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.154054:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1781685000/0xf7565228e460dab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460daab expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.154068:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1781685000/0xf7565228e460dab2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460daab expref: 14 pid: 5834 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117330.154193:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be70f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1876025385436544:0@lo:104: 00000100:00100000:0.0:1789117330.154451:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117330.154501:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c061b000 going to sleep for 11 seconds 00000100:00100000:2.0:1789117330.154789:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385436544 00000100:00100000:2.0:1789117330.154797:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385436544 00000100:00100000:2.0:1789117330.154845:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789117330.154854:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be72d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:5855:x1876025385436544:12345-0@lo:104: 00010000:00010000:2.0:1789117330.154867:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460daab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dab2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117330.154918:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789117330.154924:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be72d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:5855:x1876025385436544:12345-0@lo:104: Request processed in 71us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117330.154931:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789117330.155213:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117330.155220:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460daab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dab2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.155227:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1780030800 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:0.0:1789117330.155231:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460daab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460dab2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.155238:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460daab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460dab2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117330.155263:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460daab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460dab2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117330.155269:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789117330.155433:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460daab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dab2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.155440:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789117330.155693:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1789117330.155721:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460daab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dab2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.155733:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460daab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dab2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.155749:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117330.155751:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117330.155753:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117330.155793:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be70f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1876025385436544:0@lo:104: 00010000:00010000:0.0:1789117330.155814:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c1780031000/0xf7565228e460db61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117330.155912:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385436672:0@lo:103: 00000100:00100000:2.0:1789117330.155955:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117330.156098:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385436672 00000100:00100000:0.0:1789117330.156103:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385436672 00010000:00010000:0.0:1789117330.156125:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1781685000/0xf7565228e460dab2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460daab expref: 15 pid: 5834 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117330.157689:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789117330.157713:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17845e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:3299:x1876025385436672:12345-0@lo:103: 00010000:00010000:1.0:1789117330.157729:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117330.157737:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1781685000/0xf7565228e460dab2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460daab expref: 15 pid: 5834 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117330.157750:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1781685000/0xf7565228e460dab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460daab expref: 15 pid: 5834 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117330.157778:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1781685000/0xf7565228e460dab2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460daab expref: 15 pid: 5834 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117330.157796:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c1780031000/0xf7565228e460db61 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117330.157804:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1780031000/0xf7565228e460db61 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789117330.157821:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003849114s 00010000:00010000:1.0:1789117330.157826:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1780031000/0xf7565228e460db61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117330.157835:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1780031000/0xf7565228e460db61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117330.157842:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c1780031000/0xf7565228e460db61 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117330.157848:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c1780031000/0xf7565228e460db61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117330.157855:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1780031000 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:1.0:1789117330.157866:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c1780031000/0xf7565228e460db61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117330.157875:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c1780031000/0xf7565228e460db61 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117330.157894:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c1780031000/0xf7565228e460db61 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.157903:0:5855:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c1780031000/0xf7565228e460db61 lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117330.157905:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117330.157915:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c1780031000/0xf7565228e460db61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117330.157928:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1780031000/0xf7565228e460db61 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117330.157976:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17845e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:3299:x1876025385436672:12345-0@lo:103: Request processed in 266us (2019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117330.157985:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789117330.157993:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385436672:0@lo:103: 00000100:00100000:1.0:1789117330.160784:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:7632:x1876025385436416:12345-0@lo:253: Request processed in 36734us (36919us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117330.160797:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789117330.160957:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:7632:1876025385436416:0@lo:253: 10000000:01000000:3.0:1789117330.160971:0:7632:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789117330.160974:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789117330.160976:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789117330.160978:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789117330.160979:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789117330.160980:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789117330.160982:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789117330.160983:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789117330.160985:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789117330.160986:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789117330.160987:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789117330.160989:0:7632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789117330.161000:0:7632:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789117330.167705:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789117330.167916:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789117330.168203:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789117330.168368:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789117330.168882:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1789117330.169157:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789117330.171274:0:7632:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1789117330.247966:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789117330.345733:0:7632:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789117330.345740:0:7632:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789117330.345782:0:7632:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789117330.345837:0:7632:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.137@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789117330.345854:0:7632:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789117330.345879:0:7632:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1789117331.270547:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117332.293551:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117333.317583:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117334.342496:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117334.597517:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117334.597539:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385436800:0@lo:13: 00000100:00100000:3.0:1789117334.597599:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117334.597666:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385436800 00000100:00100000:0.0:1789117334.597674:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385436800 00000100:00100000:0.0:1789117334.597875:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789117334.597886:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385436800:12345-0@lo:13: 00002000:00000024:0.0:1789117334.597920:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789117334.597981:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385436800:12345-0@lo:13: Request processed in 97us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117334.597988:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789117334.598032:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789117334.598086:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b86a8f00 x1876025385436800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117334.598103:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385436800:0@lo:13: 00010000:00010000:0.0:1789117335.366684:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117335.621694:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178becbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385437184:0@lo:400: 00000100:00100000:1.0:1789117335.621769:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117335.621821:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117335.621828:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178beca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385437312:0@lo:400: 00000100:00100000:1.0:1789117335.621867:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117335.621908:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385437184 00000100:00100000:1.0:1789117335.621915:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385437184 00000100:00100000:1.0:1789117335.621966:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789117335.621975:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178becb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385437184:12345-0@lo:400: 00000100:00100000:1.0:1789117335.622025:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178becb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385437184:12345-0@lo:400: Request processed in 52us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117335.622041:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789117335.622067:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385437312 00000100:00100000:1.0:1789117335.622071:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385437312 00000100:00100000:1.0:1789117335.622092:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789117335.622099:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385437312:12345-0@lo:400: 00000100:00100000:1.0:1789117335.622131:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385437312:12345-0@lo:400: Request processed in 33us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117335.622138:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789117335.622152:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789117335.622179:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c178beca580 x1876025385437312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117335.622192:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178beca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385437312:0@lo:400: 00010000:00080000:1.0:1789117335.622203:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c178becbc00 x1876025385437184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117335.622211:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178becbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385437184:0@lo:400: 00000100:00100000:0.0:1789117335.622330:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178bec8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385437056:0@lo:400: 00000100:00100000:0.0:1789117335.622359:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117335.622381:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789117335.622385:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788841e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385436928:0@lo:400: 00000100:00100000:0.0:1789117335.622510:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117335.622543:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178bec8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876025385437440:0@lo:400: 00000100:00100000:0.0:1789117335.622567:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117335.622593:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385437056 00000100:00100000:0.0:1789117335.622597:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385437056 00000100:00100000:0.0:1789117335.622617:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385437440 00000100:00100000:0.0:1789117335.622619:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385437440 00000100:00100000:0.0:1789117335.622636:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789117335.622641:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385437056:12345-0@lo:400: 00000100:00100000:0.0:1789117335.622674:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385437056:12345-0@lo:400: Request processed in 32us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117335.622679:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789117335.622690:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789117335.622695:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876025385437440:12345-0@lo:400: 00000100:00100000:0.0:1789117335.622717:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876025385437440:12345-0@lo:400: Request processed in 22us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117335.622723:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789117335.622764:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789117335.622781:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c178bec8780 x1876025385437440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117335.622791:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178bec8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876025385437440:0@lo:400: 00010000:00080000:0.0:1789117335.622799:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c178bec8f00 x1876025385437056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117335.622807:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178bec8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385437056:0@lo:400: 00000100:00100000:0.0:1789117335.622934:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385436928 00000100:00100000:0.0:1789117335.622938:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385436928 00000100:00100000:0.0:1789117335.622969:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789117335.622974:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:3301:x1876025385436928:12345-0@lo:400: 00000100:00100000:0.0:1789117335.623016:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:3301:x1876025385436928:12345-0@lo:400: Request processed in 41us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117335.623022:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789117335.623050:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788841e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385436928:0@lo:400: 00000001:02000400:0.0:1789117335.831660:0:7989:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg637-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789117336.389612:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117337.413559:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117338.439127:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789117339.206655:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789117339.206661:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c17c03a3800 from 30 10000000:01000000:1.0:1789117339.206666:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789117339.206728:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1781685400/0xf7565228e460db68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117339.206739:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c1781685400/0xf7565228e460db68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117339.206750:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c1781685400/0xf7565228e460db68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117339.206792:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385437568:0@lo:101: 00000100:00100000:1.0:1789117339.206855:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117339.206910:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787303c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789117339.207041:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385437568 00000100:00100000:2.0:1789117339.207048:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385437568 00000100:00100000:2.0:1789117339.207094:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789117339.207103:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:5837:x1876025385437568:12345-0@lo:101: 00010000:00010000:2.0:1789117339.207116:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117339.207130:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178457e000/0xf7565228e460db6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460db68 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117339.207153:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178457e000/0xf7565228e460db6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460db68 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117339.207163:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178457e000/0xf7565228e460db6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460db68 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117339.207172:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457e000, rc 0) 00000100:00100000:2.0:1789117339.207217:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:5837:x1876025385437568:12345-0@lo:101: Request processed in 115us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117339.207224:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789117339.207513:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385437568:0@lo:101: 00010000:00010000:1.0:1789117339.207527:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c1781685400/0xf7565228e460db68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db6f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117339.207537:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c1781685400/0xf7565228e460db68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460db6f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117339.207589:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385437696:0@lo:501: 00000100:00100000:1.0:1789117339.207631:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117339.207649:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787303c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789117339.207703:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385437696 00000100:00100000:2.0:1789117339.207707:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385437696 00000100:00100000:2.0:1789117339.207747:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789117339.207755:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:5837:x1876025385437696:12345-0@lo:501: 00000100:00100000:2.0:1789117339.208253:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:5837:x1876025385437696:12345-0@lo:501: Request processed in 496us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117339.208344:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385437696:0@lo:501: 00000100:00100000:1.0:1789117339.208373:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385437824:0@lo:503: 00000100:00100000:1.0:1789117339.208429:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117339.208454:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787303c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117339.208466:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385437824 00000100:00100000:1.0:1789117339.208470:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385437824 00000100:00100000:2.0:1789117339.208516:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789117339.212213:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789117339.212231:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:5837:x1876025385437824:12345-0@lo:503: 00000100:00100000:1.0:1789117339.212603:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:5837:x1876025385437824:12345-0@lo:503: Request processed in 378us (4172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117339.212611:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789117339.212836:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385437824:0@lo:503: 00000100:00100000:0.0:1789117339.219654:0:8145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be71a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8145:1876025385437952:0@lo:502: 00000100:00100000:0.0:1789117339.219755:0:8145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117339.219811:0:8145:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785c04d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789117339.219966:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385437952 00000100:00100000:1.0:1789117339.219973:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385437952 00000100:00100000:1.0:1789117339.220021:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789117339.220031:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:8145:x1876025385437952:12345-0@lo:502: 00000100:00100000:1.0:1789117339.220352:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:8145:x1876025385437952:12345-0@lo:502: Request processed in 321us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117339.220361:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789117339.222555:0:8145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be71a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8145:1876025385437952:0@lo:502: 00000100:00100000:2.0:1789117339.222632:0:8145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8145:1876025385438080:0@lo:502: 00000100:00100000:2.0:1789117339.223127:0:8145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117339.223207:0:8145:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1782c81840 going to sleep for 11 seconds 00000100:00100000:0.0:1789117339.225201:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385438080 00000100:00100000:0.0:1789117339.225212:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385438080 00000100:00100000:0.0:1789117339.225256:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789117339.225275:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:8145:x1876025385438080:12345-0@lo:502: 00000100:00100000:3.0:1789117339.225814:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:8145:x1876025385438080:12345-0@lo:502: Request processed in 540us (2686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117339.225823:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789117339.225994:0:8145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8145:1876025385438080:0@lo:502: 00000040:00080000:0.0:1789117339.226024:0:8145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789117339.226126:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789117339.226146:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789117339.226155:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1781685400/0xf7565228e460db68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db6f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117339.226167:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c1781685400/0xf7565228e460db68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db6f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117339.226175:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789117339.226178:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789117339.226180:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789117339.226208:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1781684c00/0xf7565228e460db76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117339.226215:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c1781684c00/0xf7565228e460db76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117339.226223:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c1781684c00/0xf7565228e460db76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117339.226240:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385438208:0@lo:101: 00000100:00100000:1.0:1789117339.226287:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117339.226331:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787303b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789117339.234169:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385438208 00000100:00100000:3.0:1789117339.234182:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385438208 00000100:00100000:3.0:1789117339.234235:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789117339.234245:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:5837:x1876025385438208:12345-0@lo:101: 00010000:00010000:3.0:1789117339.235235:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117339.235257:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178149de00/0xf7565228e460db7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460db76 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117339.235765:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178149de00/0xf7565228e460db7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460db76 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117339.235850:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178149de00/0xf7565228e460db7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460db76 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117339.235860:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178149de00, rc 0) 00000100:00100000:3.0:1789117339.235937:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:5837:x1876025385438208:12345-0@lo:101: Request processed in 1694us (9650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117339.235952:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789117339.236434:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385438208:0@lo:101: 00010000:00010000:1.0:1789117339.236455:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c1781684c00/0xf7565228e460db76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db7d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117339.236465:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c1781684c00/0xf7565228e460db76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460db7d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117339.236533:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385438336:0@lo:501: 00000100:00100000:1.0:1789117339.236568:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117339.236606:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787303b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789117339.236668:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385438336 00000100:00100000:0.0:1789117339.236754:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385438336 00000100:00100000:0.0:1789117339.237155:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789117339.237166:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:5837:x1876025385438336:12345-0@lo:501: 00000100:00100000:1.0:1789117339.238123:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:5837:x1876025385438336:12345-0@lo:501: Request processed in 956us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117339.238132:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789117339.238205:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385438336:0@lo:501: 00000100:00100000:0.0:1789117339.238246:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385438464:0@lo:503: 00000100:00100000:0.0:1789117339.238507:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117339.239919:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785c04240 going to sleep for 11 seconds 00000100:00100000:3.0:1789117339.244877:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385438464 00000100:00100000:3.0:1789117339.244889:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385438464 00000100:00100000:3.0:1789117339.244990:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789117339.245000:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:5837:x1876025385438464:12345-0@lo:503: 00000100:00100000:3.0:1789117339.245416:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:5837:x1876025385438464:12345-0@lo:503: Request processed in 401us (6892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117339.245424:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789117339.245531:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385438464:0@lo:503: 00000100:00100000:0.0:1789117339.246596:0:8148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8148:1876025385438592:0@lo:502: 00000100:00100000:0.0:1789117339.246642:0:8148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117339.247263:0:8148:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785c04f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117339.247330:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385438592 00000100:00100000:1.0:1789117339.247336:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385438592 00000100:00100000:1.0:1789117339.247368:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789117339.247376:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:8148:x1876025385438592:12345-0@lo:502: 00000100:00100000:1.0:1789117339.247641:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:8148:x1876025385438592:12345-0@lo:502: Request processed in 264us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117339.247648:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789117339.250305:0:8148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8148:1876025385438592:0@lo:502: 00000020:01000000:0.0:1789117339.250344:0:8148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117339.250354:0:8148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117339.250356:0:8148:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789117339.250362:0:8148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789117339.250364:0:8148:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789117339.250394:0:8148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8148:1876025385438720:0@lo:502: 00000100:00100000:0.0:1789117339.250495:0:8148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117339.250536:0:8148:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785c04f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117339.251219:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385438720 00000100:00100000:1.0:1789117339.251225:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385438720 00000100:00100000:1.0:1789117339.251263:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789117339.251272:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:8148:x1876025385438720:12345-0@lo:502: 00000100:00100000:1.0:1789117339.251506:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:8148:x1876025385438720:12345-0@lo:502: Request processed in 234us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117339.251514:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789117339.251807:0:8148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8148:1876025385438720:0@lo:502: 00000020:01000000:0.0:1789117339.251828:0:8148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117339.251834:0:8148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117339.251836:0:8148:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789117339.251840:0:8148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1789117339.251897:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789117339.251915:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789117339.251924:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1781684c00/0xf7565228e460db76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db7d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117339.251934:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c1781684c00/0xf7565228e460db76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db7d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117339.251942:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789117339.251945:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c178548d000 from 30 10000000:01000000:0.0:1789117339.251947:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789117339.251975:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460db84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117339.251984:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460db84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117339.251993:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460db84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117339.252006:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385438848:0@lo:101: 00000100:00100000:0.0:1789117339.252049:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117339.252076:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785c04f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117339.252271:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385438848 00000100:00100000:1.0:1789117339.252276:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385438848 00000100:00100000:1.0:1789117339.252297:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789117339.252303:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:5837:x1876025385438848:12345-0@lo:101: 00010000:00010000:1.0:1789117339.252312:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117339.252324:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1781685200/0xf7565228e460db8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460db84 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117339.252345:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1781685200/0xf7565228e460db8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460db84 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117339.252355:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1781685200/0xf7565228e460db8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460db84 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117339.252364:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685200, rc 0) 00000100:00100000:1.0:1789117339.252423:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:5837:x1876025385438848:12345-0@lo:101: Request processed in 120us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117339.252430:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789117339.253921:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385438848:0@lo:101: 00010000:00010000:0.0:1789117339.253939:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460db84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db8b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117339.253950:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460db84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460db8b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117339.254004:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385438976:0@lo:501: 00000100:00100000:0.0:1789117339.254105:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117339.254143:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785c04f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117339.254185:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385438976 00000100:00100000:3.0:1789117339.254189:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385438976 00000100:00100000:3.0:1789117339.254227:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789117339.254235:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:5837:x1876025385438976:12345-0@lo:501: 00000100:00100000:3.0:1789117339.254481:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:5837:x1876025385438976:12345-0@lo:501: Request processed in 246us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117339.254489:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789117339.254583:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385438976:0@lo:501: 00000100:00100000:0.0:1789117339.254608:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385439104:0@lo:503: 00000100:00100000:0.0:1789117339.254643:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117339.254665:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785c04f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117339.254758:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385439104 00000100:00100000:0.0:1789117339.254763:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385439104 00000100:00100000:0.0:1789117339.254855:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789117339.254862:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:5837:x1876025385439104:12345-0@lo:503: 00000100:00100000:0.0:1789117339.254997:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:5837:x1876025385439104:12345-0@lo:503: Request processed in 134us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117339.255003:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789117339.255114:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385439104:0@lo:503: 00000100:00100000:0.0:1789117339.255272:0:8150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8150:1876025385439232:0@lo:502: 00000100:00100000:0.0:1789117339.255306:0:8150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117339.255325:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385439232 00000100:00100000:0.0:1789117339.255329:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385439232 00000100:00100000:0.0:1789117339.255349:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789117339.255355:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:8150:x1876025385439232:12345-0@lo:502: 00000100:00100000:0.0:1789117339.255524:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:8150:x1876025385439232:12345-0@lo:502: Request processed in 168us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117339.255530:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789117339.255563:0:8150:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785c04780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117339.255574:0:8150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8150:1876025385439232:0@lo:502: 00000100:00100000:0.0:1789117339.255608:0:8150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8150:1876025385439360:0@lo:502: 00000100:00100000:0.0:1789117339.255637:0:8150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117339.255655:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385439360 00000100:00100000:0.0:1789117339.255658:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385439360 00000100:00100000:0.0:1789117339.256452:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789117339.256461:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:8150:x1876025385439360:12345-0@lo:502: 00000100:00100000:0.0:1789117339.256601:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:8150:x1876025385439360:12345-0@lo:502: Request processed in 142us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117339.256616:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789117339.256654:0:8150:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785c04780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117339.256667:0:8150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8150:1876025385439360:0@lo:502: 00000040:00080000:0.0:1789117339.256701:0:8150:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789117339.256754:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789117339.256768:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789117339.256786:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460db84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db8b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117339.256796:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460db84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db8b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117339.256805:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789117339.256808:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c178548d000 from 5 10000000:01000000:0.0:1789117339.256810:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789117339.256836:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1780031000/0xf7565228e460db92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117339.256843:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c1780031000/0xf7565228e460db92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117339.256851:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c1780031000/0xf7565228e460db92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117339.256863:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385439488:0@lo:101: 00000100:00100000:0.0:1789117339.256889:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117339.256907:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785c04780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117339.256918:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385439488 00000100:00100000:0.0:1789117339.256922:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385439488 00000100:00100000:0.0:1789117339.256948:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789117339.256954:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:5837:x1876025385439488:12345-0@lo:101: 00010000:00010000:0.0:1789117339.256962:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117339.256973:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1780030400/0xf7565228e460db99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460db92 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117339.256991:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1780030400/0xf7565228e460db99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460db92 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117339.257000:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1780030400/0xf7565228e460db99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460db92 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117339.257008:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1780030400, rc 0) 00000100:00100000:0.0:1789117339.257262:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385439488:12345-0@lo:101: Request processed in 307us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117339.257269:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789117339.257300:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385439488:0@lo:101: 00010000:00010000:0.0:1789117339.257310:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c1780031000/0xf7565228e460db92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db99 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117339.257318:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c1780031000/0xf7565228e460db92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460db99 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117339.257358:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385439616:0@lo:256: 00000100:00100000:0.0:1789117339.257387:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117339.257434:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785c04780 going to sleep for 11 seconds 00000100:00100000:2.0:1789117339.257506:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385439616 00000100:00100000:2.0:1789117339.257511:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385439616 00000100:00100000:2.0:1789117339.257539:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789117339.257547:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385439616:12345-0@lo:256: 20000000:01000000:2.0:1789117339.257560:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789117339.257575:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789117339.257577:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789117339.257652:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385439616:12345-0@lo:256: Request processed in 107us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117339.257660:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789117339.257707:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385439616:0@lo:256: 10000000:01000000:2.0:1789117339.257757:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789117339.257763:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1780031000/0xf7565228e460db92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db99 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117339.257781:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c1780031000/0xf7565228e460db92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db99 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117339.257788:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789117339.257790:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789117339.257792:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789117339.257808:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460dba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117339.257823:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460dba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117339.257830:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460dba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117339.257841:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385439744:0@lo:101: 00000100:00100000:2.0:1789117339.257864:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117339.257877:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1782c81180 going to sleep for 11 seconds 00000100:00100000:2.0:1789117339.257889:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385439744 00000100:00100000:2.0:1789117339.257892:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385439744 00000100:00100000:2.0:1789117339.257912:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789117339.257919:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385439744:12345-0@lo:101: 00010000:00010000:2.0:1789117339.257925:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117339.257933:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178457ee00/0xf7565228e460dba7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dba0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117339.257945:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178457ee00/0xf7565228e460dba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dba0 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117339.257953:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178457ee00/0xf7565228e460dba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dba0 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117339.257959:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457ee00, rc 0) 00000100:00100000:2.0:1789117339.257987:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385439744:12345-0@lo:101: Request processed in 68us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117339.257993:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789117339.258021:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385439744:0@lo:101: 00010000:00010000:2.0:1789117339.258049:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460dba0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dba7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117339.258058:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460dba0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dba7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117339.258097:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385439872:0@lo:501: 00000100:00100000:2.0:1789117339.258121:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117339.258133:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1782c81180 going to sleep for 11 seconds 00000100:00100000:2.0:1789117339.258144:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385439872 00000100:00100000:2.0:1789117339.258147:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385439872 00000100:00100000:2.0:1789117339.258168:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789117339.258173:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385439872:12345-0@lo:501: 00000100:00100000:2.0:1789117339.258371:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385439872:12345-0@lo:501: Request processed in 196us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117339.258377:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789117339.258437:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385439872:0@lo:501: 00000100:00100000:2.0:1789117339.258462:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385440000:0@lo:503: 00000100:00100000:2.0:1789117339.258497:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117339.258509:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1782c81180 going to sleep for 11 seconds 00000100:00100000:2.0:1789117339.258520:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385440000 00000100:00100000:2.0:1789117339.258523:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385440000 00000100:00100000:2.0:1789117339.258543:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789117339.258549:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385440000:12345-0@lo:503: 00000100:00100000:2.0:1789117339.258819:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385440000:12345-0@lo:503: Request processed in 267us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117339.258825:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789117339.258868:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385440000:0@lo:503: 00000100:00100000:3.0:1789117339.260280:0:8151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8151:1876025385440128:0@lo:502: 00000100:00100000:3.0:1789117339.260336:0:8151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117339.260535:0:8151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1783151240 going to sleep for 11 seconds 00000100:00100000:2.0:1789117339.260630:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385440128 00000100:00100000:2.0:1789117339.260635:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385440128 00000100:00100000:2.0:1789117339.260678:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789117339.260687:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:8151:x1876025385440128:12345-0@lo:502: 00000100:00100000:2.0:1789117339.261134:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:8151:x1876025385440128:12345-0@lo:502: Request processed in 448us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117339.261142:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789117339.261465:0:8151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8151:1876025385440128:0@lo:502: 00000020:01000000:0.0:1789117339.261493:0:8151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789117339.261505:0:8151:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789117339.261511:0:8151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117339.261513:0:8151:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789117339.261518:0:8151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789117339.261521:0:8151:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.137@tcp to nid 0x20000c0a8ce89 (192.168.206.137@tcp) 00000020:01000000:0.0:1789117339.261540:0:8151:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789117339.261543:0:8151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789117339.261556:0:8151:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c178829b490) 00000020:00000080:0.0:1789117339.261574:0:8151:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789117339.261578:0:8151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789117339.261648:0:8151:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789117339.261654:0:8151:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789117339.261660:0:8151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7565228e460dbb5 00010000:00080000:0.0:1789117339.261688:0:8151:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c16822f9000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.137@tcp at head 00010000:00010000:0.0:1789117339.261904:0:8151:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1789117339.262232:0:8151:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789117339.262244:0:8151:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789117339.263845:0:8151:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789117339.265790:0:8151:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789117339.265848:0:8151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789117339.265912:0:8151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789117339.267375:0:8153:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789117339.267381:0:8153:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789117339.268654:0:8151:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789117339.268666:0:8151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789117339.268841:0:8151:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789117339.268864:0:8151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7565228e460dbbc 00000100:00080000:3.0:1789117339.268874:0:8151:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789117339.268879:0:8151:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c16822f9000 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:3.0:1789117339.268912:0:8151:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c17b86aad00 x1876025385440256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789117339.268978:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385440256:0@lo:8: 00000100:00100000:2.0:1789117339.269112:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789117339.269176:0:8151:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1789117339.269231:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385440384:0@lo:400: 00000100:00100000:0.0:1789117339.269260:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1789117339.269281:0:8151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1789117339.269283:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:00000080:3.0:1789117339.269286:0:8151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117339.269288:0:8151:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000100:00100000:0.0:1789117339.269288:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876025385440768:0@lo:400: 00000020:01000000:3.0:1789117339.269291:0:8151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117339.269294:0:8151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117339.269296:0:8151:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789117339.269299:0:8151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789117339.269300:0:8151:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789117339.269309:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117339.269319:0:8151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8151:1876025385440896:0@lo:502: 00000100:00100000:0.0:1789117339.269334:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385440384 00000100:00100000:0.0:1789117339.269339:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385440384 00000100:00100000:3.0:1789117339.269359:0:8151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117339.269373:0:8151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1783151b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789117339.269438:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385440256 00000100:00100000:1.0:1789117339.269442:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385440256 00000100:00100000:0.0:1789117339.269460:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385440768 00000100:00100000:1.0:1789117339.269463:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789117339.269464:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385440768 00000100:00100000:1.0:1789117339.269469:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3297:x1876025385440256:12345-0@lo:8: 00000100:00100000:0.0:1789117339.269487:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789117339.269489:0:6687:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000100:00100000:0.0:1789117339.269499:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385440384:12345-0@lo:400: 00000020:00000080:1.0:1789117339.269510:0:6687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7565228e460dbc3 00002000:00100000:1.0:1789117339.269521:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c17b7c50800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789117339.269525:0:6687:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1789117339.269528:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789117339.269538:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385440384:12345-0@lo:400: Request processed in 41us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117339.269544:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789117339.269557:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789117339.269563:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876025385440768:12345-0@lo:400: 00000100:00100000:0.0:1789117339.269589:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876025385440768:12345-0@lo:400: Request processed in 26us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117339.269594:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00002000:00100000:1.0:1789117339.269625:0:6687:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1789117339.269638:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789117339.269663:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b86a92c0 x1876025385440768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117339.269675:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876025385440768:0@lo:400: 00010000:00080000:0.0:1789117339.269686:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b86a8780 x1876025385440384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117339.269694:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385440384:0@lo:400: 00002000:00080000:1.0:1789117339.269801:0:6687:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789117339.269821:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9c17b7c56000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789117339.271375:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3297:x1876025385440256:12345-0@lo:8: Request processed in 1900us (2258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117339.271384:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789117339.271427:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385440512:0@lo:400: 00000100:00100000:1.0:1789117339.271464:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117339.271486:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117339.271492:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385440640:0@lo:400: 00000100:00100000:1.0:1789117339.271515:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117339.271547:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385440896 00000100:00100000:1.0:1789117339.271553:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385440896 00000100:00100000:1.0:1789117339.271583:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789117339.271591:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:8151:x1876025385440896:12345-0@lo:502: 00000100:00100000:1.0:1789117339.271894:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:8151:x1876025385440896:12345-0@lo:502: Request processed in 303us (2534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117339.271902:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789117339.271935:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385440640 00000100:00100000:1.0:1789117339.271938:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385440640 00000100:00100000:1.0:1789117339.271970:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789117339.271976:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385440640:12345-0@lo:400: 00000100:00100000:1.0:1789117339.272011:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385440640:12345-0@lo:400: Request processed in 35us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117339.272017:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789117339.272249:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789117339.272273:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b86a9e00 x1876025385440640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117339.272285:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385440640:0@lo:400: 00000100:00100000:3.0:1789117339.272365:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385440512 00000100:00100000:3.0:1789117339.272370:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385440512 00000100:00100000:3.0:1789117339.272438:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789117339.272446:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385440512:12345-0@lo:400: 00000100:00100000:3.0:1789117339.272483:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385440512:12345-0@lo:400: Request processed in 38us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117339.272489:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789117339.272517:0:8151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8151:1876025385440896:0@lo:502: 00000020:01000000:3.0:1789117339.272544:0:8151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117339.272549:0:8151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117339.272551:0:8151:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789117339.272556:0:8151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00080000:1.0:1789117339.272936:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789117339.272955:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b86a9a40 x1876025385440512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117339.272964:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385440512:0@lo:400: 00010000:00080000:2.0:1789117339.273099:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b86aad00 x1876025385440256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789117349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117339.273109:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789117339.273116:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789117339.273124:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789117339.273128:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789117339.273131:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c16822f9000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789117339.273185:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789117339.273191:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385440256:0@lo:8: 00000020:01000000:2.0:1789117339.273209:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789117339.273230:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789117339.273239:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460dba0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dba7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117339.273249:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460dba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dba7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117339.273269:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789117339.273272:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c17882d4ed8 from 1 10000000:01000000:2.0:1789117339.273274:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789117339.273300:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e800/0xf7565228e460dbca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117339.273308:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178457e800/0xf7565228e460dbca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117339.273317:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178457e800/0xf7565228e460dbca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117339.273332:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385441024:0@lo:101: 00000100:00100000:2.0:1789117339.273362:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117339.273388:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17906b7f00 going to sleep for 11 seconds 00000004:00080000:3.0:1789117339.273462:0:8153:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789117339.273564:0:8153:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 186403163122ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789117339.273607:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385441024 00000100:00100000:2.0:1789117339.273612:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385441024 00000100:00100000:2.0:1789117339.273639:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789117339.273646:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385441024:12345-0@lo:101: 00010000:00010000:2.0:1789117339.273654:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117339.273665:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178457fe00/0xf7565228e460dbd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dbca expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117339.273765:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178457fe00/0xf7565228e460dbd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dbca expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117339.273843:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178457fe00/0xf7565228e460dbd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dbca expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117339.273861:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457fe00, rc 0) 00000100:00100000:2.0:1789117339.273892:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385441024:12345-0@lo:101: Request processed in 246us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117339.273898:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789117339.273927:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385441024:0@lo:101: 00010000:00010000:2.0:1789117339.273939:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178457e800/0xf7565228e460dbca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dbd1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117339.273947:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178457e800/0xf7565228e460dbca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dbd1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117339.273987:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385441152:0@lo:501: 00000100:00100000:2.0:1789117339.274010:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117339.274359:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17831c9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117339.274373:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385441152 00000100:00100000:2.0:1789117339.274377:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385441152 00000100:00100000:2.0:1789117339.274442:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789117339.274449:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385441152:12345-0@lo:501: 00000100:00100000:2.0:1789117339.274609:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385441152:12345-0@lo:501: Request processed in 160us (597us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789117339.274616:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789117339.274656:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385441152:0@lo:501: 10000000:01000000:2.0:1789117339.274839:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789117339.274846:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e800/0xf7565228e460dbca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dbd1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117339.274863:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178457e800/0xf7565228e460dbca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dbd1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789117339.303633:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789117339.359734:0:8155:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789117339.359753:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385441280:0@lo:13: 00000100:00100000:3.0:1789117339.359766:0:8155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86ab480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8155:1876025385441408:0@lo:7: 00000100:00100000:3.0:1789117339.359836:0:8155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117339.359837:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117339.367705:0:8155:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788f88600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117339.367742:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385441408 00000100:00100000:3.0:1789117339.367751:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385441408 00000100:00080000:1.0:1789117339.368778:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117339.368858:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789117339.368871:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8155:x1876025385441408:12345-0@lo:7: 00000100:00100000:2.0:1789117339.376582:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385441280 00000100:00100000:2.0:1789117339.376594:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385441280 00000100:00100000:2.0:1789117339.376651:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789117339.376661:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1876025385441280:12345-0@lo:13: 00002000:00000024:2.0:1789117339.376692:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1789117339.376808:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1876025385441280:12345-0@lo:13: Request processed in 148us (16978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117339.376815:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789117339.377163:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b86a8000 x1876025385441280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117339.377184:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385441280:0@lo:13: 00002000:00080000:3.0:1789117339.387695:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789117339.387703:0:6686:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789117339.388303:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8155:x1876025385441408:12345-0@lo:7: Request processed in 19430us (28468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117339.388314:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789117339.388438:0:8155:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b86ab480 x1876025385441408/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789117355 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117339.388452:0:8155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86ab480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8155:1876025385441408:0@lo:7: 00000004:00080000:0.0:1789117339.388464:0:8155:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789117339.388499:0:8155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be71e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8155:1876025385441536:0@lo:5: 00000100:00100000:0.0:1789117339.388534:0:8155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117339.388567:0:8155:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c179054f480 going to sleep for 11 seconds 00000100:00100000:1.0:1789117339.388585:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385441536 00000100:00100000:1.0:1789117339.388593:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385441536 00000100:00100000:1.0:1789117339.388645:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789117339.388655:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788841e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8155:x1876025385441536:12345-0@lo:5: 00002000:00080000:1.0:1789117339.388680:0:6687:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789117339.388684:0:6687:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789117339.389346:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788841e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8155:x1876025385441536:12345-0@lo:5: Request processed in 692us (810us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789117339.389354:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789117339.389491:0:8155:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c178be71e00 x1876025385441536/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789117355 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117339.389515:0:8155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be71e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8155:1876025385441536:0@lo:5: 00000004:00080000:0.0:1789117339.389525:0:8155:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789117339.389551:0:8155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305d680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8155:1876025385441664:0@lo:700: 00000100:00100000:0.0:1789117339.389579:0:8155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117339.389602:0:8155:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c179054f480 going to sleep for 11 seconds 00000100:00100000:1.0:1789117339.389693:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385441664 00000100:00100000:1.0:1789117339.389698:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385441664 00000100:00100000:1.0:1789117339.389745:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789117339.389754:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179305de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8155:x1876025385441664:12345-0@lo:700: 00000100:00100000:1.0:1789117339.389784:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6693:1876025385441792:0@lo:700: 00000100:00100000:1.0:1789117339.389817:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117339.389849:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17985eaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117339.390585:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385441792 00000100:00100000:3.0:1789117339.390592:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385441792 00000100:00100000:3.0:1789117339.390637:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789117339.390646:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6693:x1876025385441792:12345-0@lo:700: 40000000:02000000:3.0:1789117339.447198:0:5846:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1789117339.457589:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6693:x1876025385441792:12345-0@lo:700: Request processed in 66938us (67763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117339.457602:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789117339.460391:0:6693:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b87ea940 x1876025385441792/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789117355 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117339.460438:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6693:1876025385441792:0@lo:700: 40000000:02000000:1.0:1789117339.460451:0:6693:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:2.0:1789117339.464792:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789117339.603808:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1789117339.603822:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789117339.604038:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179305de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8155:x1876025385441664:12345-0@lo:700: Request processed in 214281us (214454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117339.604051:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789117339.604148:0:8155:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c179305d680 x1876025385441664/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789117355 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117339.604159:0:8155:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789117339.604176:0:8155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305d680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8155:1876025385441664:0@lo:700: 00000004:02000040:1.0:1789117339.632570:0:8155:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1789117339.637729:0:8155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8155:1876025385441920:0@lo:5: 00000100:00100000:1.0:1789117339.637795:0:8155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117339.637847:0:8155:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17985ea000 going to sleep for 11 seconds 00000100:00100000:2.0:1789117339.637914:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385441920 00000100:00100000:2.0:1789117339.637921:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385441920 00000100:00100000:2.0:1789117339.637964:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789117339.637971:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8155:x1876025385441920:12345-0@lo:5: 00002000:00080000:3.0:1789117339.649129:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789117339.649148:0:6686:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00010000:00080000:1.0:1789117339.653422:0:8155:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b87ea940 x1876025385441920/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789117355 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117339.653443:0:8155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8155:1876025385441920:0@lo:5: 00000004:00080000:1.0:1789117339.653463:0:8155:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1789117339.654343:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8155:x1876025385441920:12345-0@lo:5: Request processed in 15252us (15428us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789117339.654356:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789117339.718973:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385442048:0@lo:13: 00000100:00100000:1.0:1789117339.719054:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117339.719171:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385442048 00000100:00100000:3.0:1789117339.719178:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385442048 00000100:00100000:3.0:1789117339.719232:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789117339.719241:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385442048:12345-0@lo:13: 00002000:00000024:3.0:1789117339.719272:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117339.719315:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385442048:12345-0@lo:13: Request processed in 76us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117339.719339:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789117339.719812:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b86a9a40 x1876025385442048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117339.719830:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385442048:0@lo:13: 00000001:00080000:0.0:1789117340.303890:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1789117340.489110:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117340.922460:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117340.922633:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362350208 00000100:00100000:1.0:1789117340.922642:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362350208 00000100:00100000:1.0:1789117340.922685:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 112 00000100:00100000:1.0:1789117340.922693:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2348:x1876025362350208:12345-192.168.206.37@tcp:250: 00010000:00080000:1.0:1789117340.922750:0:5835:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 712c9f48-d1f0-41ea-ba66-2b9a8d7109b1@192.168.206.37@tcp t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:1.0:1789117340.923345:0:5835:0:(genops.c:1385:class_connect()) connect: client 712c9f48-d1f0-41ea-ba66-2b9a8d7109b1, cookie 0xf7565228e460dbd8 00000100:00080000:1.0:1789117340.923503:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9c17b7c57000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789117340.923571:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+5:2348:x1876025362350208:12345-192.168.206.37@tcp:250: Request processed in 877us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117340.923580:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 112 00000100:00100000:0.0:1789117340.930290:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117340.930420:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362350336 00000100:00100000:2.0:1789117340.930430:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362350336 00000100:00100000:2.0:1789117340.930476:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 113 00000100:00100000:2.0:1789117340.930486:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+5:5591:x1876025362350336:12345-192.168.206.37@tcp:101: 00010000:00010000:2.0:1789117340.930502:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117340.930518:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178457ea00/0xf7565228e460dbdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c656 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117340.930552:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178457ea00/0xf7565228e460dbdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c656 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117340.930562:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178457ea00/0xf7565228e460dbdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c656 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117340.930570:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457ea00, rc 0) 00000100:00100000:2.0:1789117340.930613:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+6:5591:x1876025362350336:12345-192.168.206.37@tcp:101: Request processed in 128us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117340.930620:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 113 00000100:00100000:1.0:1789117340.946924:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117340.947000:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362350464 00000100:00100000:0.0:1789117340.947009:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362350464 00000100:00100000:0.0:1789117340.947058:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 114 00000100:00100000:0.0:1789117340.947068:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+6:5591:x1876025362350464:12345-192.168.206.37@tcp:501: 00000100:00100000:0.0:1789117340.947371:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+6:5591:x1876025362350464:12345-192.168.206.37@tcp:501: Request processed in 304us (454us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789117340.947379:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 114 00000100:00100000:0.0:1789117340.953029:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117340.956470:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362350592 00000100:00100000:3.0:1789117340.956483:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362350592 00000100:00100000:3.0:1789117340.956550:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 115 00000100:00100000:3.0:1789117340.956560:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+6:5591:x1876025362350592:12345-192.168.206.37@tcp:101: 00010000:00010000:3.0:1789117340.956576:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117340.956593:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178149ca00/0xf7565228e460dbe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c65d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117340.956620:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178149ca00/0xf7565228e460dbe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c65d expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117340.956630:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178149ca00/0xf7565228e460dbe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c65d expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117340.956639:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178149ca00, rc 0) 00000100:00100000:3.0:1789117340.956703:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+7:5591:x1876025362350592:12345-192.168.206.37@tcp:101: Request processed in 144us (3683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117340.956721:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 115 00000100:00100000:3.0:1789117340.958306:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117340.958334:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362350720 00000100:00100000:3.0:1789117340.958339:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362350720 00000100:00100000:3.0:1789117340.958373:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 116 00000100:00100000:3.0:1789117340.958381:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+7:5591:x1876025362350720:12345-192.168.206.37@tcp:501: 00000100:00100000:3.0:1789117340.958644:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+8:5591:x1876025362350720:12345-192.168.206.37@tcp:501: Request processed in 263us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117340.958652:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 116 00000100:00100000:3.0:1789117340.962851:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117340.966505:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362350848 00000100:00100000:1.0:1789117340.966518:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362350848 00000100:00100000:1.0:1789117340.966577:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 117 00000100:00100000:1.0:1789117340.966586:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+8:5591:x1876025362350848:12345-192.168.206.37@tcp:503: 00000100:00100000:1.0:1789117340.966967:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+8:5591:x1876025362350848:12345-192.168.206.37@tcp:503: Request processed in 380us (4124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117340.966975:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 117 00000100:00100000:3.0:1789117340.969446:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117340.970029:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362350976 00000100:00100000:2.0:1789117340.970038:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362350976 00000100:00100000:2.0:1789117340.970081:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 118 00000100:00100000:2.0:1789117340.970091:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+8:5610:x1876025362350976:12345-192.168.206.37@tcp:502: 00000100:00100000:2.0:1789117340.970381:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+8:5610:x1876025362350976:12345-192.168.206.37@tcp:502: Request processed in 290us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117340.970389:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 118 00000100:00100000:2.0:1789117341.005290:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117341.005378:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362351104 00000100:00100000:3.0:1789117341.005386:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362351104 00000100:00100000:3.0:1789117341.005442:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 119 00000100:00100000:3.0:1789117341.005451:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+8:5610:x1876025362351104:12345-192.168.206.37@tcp:502: 00000100:00100000:3.0:1789117341.005676:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+8:5610:x1876025362351104:12345-192.168.206.37@tcp:502: Request processed in 225us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117341.005684:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 119 00000100:00100000:0.0:1789117341.009671:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117341.010095:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362351232 00000100:00100000:1.0:1789117341.010104:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362351232 00000100:00100000:1.0:1789117341.010152:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 120 00000100:00100000:1.0:1789117341.010163:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+8:5591:x1876025362351232:12345-192.168.206.37@tcp:101: 00010000:00010000:1.0:1789117341.010179:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117341.010196:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1781684a00/0xf7565228e460dbed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c687 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117341.010221:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1781684a00/0xf7565228e460dbed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c687 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117341.010238:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1781684a00/0xf7565228e460dbed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c687 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117341.010259:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781684a00, rc 0) 00000100:00100000:1.0:1789117341.010316:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+9:5591:x1876025362351232:12345-192.168.206.37@tcp:101: Request processed in 155us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117341.010324:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 120 00000100:00100000:0.0:1789117341.017691:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117341.018037:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362351360 00000100:00100000:3.0:1789117341.018046:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362351360 00000100:00100000:3.0:1789117341.018096:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 121 00000100:00100000:3.0:1789117341.018105:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+9:5591:x1876025362351360:12345-192.168.206.37@tcp:256: 20000000:01000000:3.0:1789117341.018126:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789117341.018143:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789117341.018146:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789117341.018149:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789117341.018152:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789117341.019932:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+9:5591:x1876025362351360:12345-192.168.206.37@tcp:256: Request processed in 1820us (2242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117341.019944:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 121 00000100:00100000:3.0:1789117341.022491:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117341.022592:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362351488 00000100:00100000:0.0:1789117341.022601:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362351488 00000100:00100000:0.0:1789117341.022653:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 122 00000100:00100000:0.0:1789117341.022663:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+9:5591:x1876025362351488:12345-192.168.206.37@tcp:101: 00010000:00010000:0.0:1789117341.022678:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117341.022697:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1780030600/0xf7565228e460dbf4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c68e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117341.022734:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1780030600/0xf7565228e460dbf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c68e expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117341.022744:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1780030600/0xf7565228e460dbf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c68e expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117341.022753:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1780030600, rc 0) 00000100:00100000:0.0:1789117341.022813:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:5591:x1876025362351488:12345-192.168.206.37@tcp:101: Request processed in 151us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117341.022820:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 122 00000100:00100000:2.0:1789117341.026961:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117341.027260:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362351616 00000100:00100000:3.0:1789117341.027270:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362351616 00000100:00100000:3.0:1789117341.027322:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 123 00000100:00100000:3.0:1789117341.027333:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:5591:x1876025362351616:12345-192.168.206.37@tcp:501: 00000100:00100000:3.0:1789117341.028379:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:5591:x1876025362351616:12345-192.168.206.37@tcp:501: Request processed in 1044us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117341.028389:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 123 00000100:00100000:1.0:1789117341.034355:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117341.035076:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362351744 00000100:00100000:2.0:1789117341.035085:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362351744 00000100:00100000:2.0:1789117341.035141:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 124 00000100:00100000:2.0:1789117341.035151:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:5591:x1876025362351744:12345-192.168.206.37@tcp:503: 00000100:00100000:2.0:1789117341.035495:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:5591:x1876025362351744:12345-192.168.206.37@tcp:503: Request processed in 344us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117341.035503:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 124 00000100:00100000:3.0:1789117341.041673:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117341.041735:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362351872 00000100:00100000:3.0:1789117341.041744:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362351872 00000100:00100000:3.0:1789117341.041855:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 125 00000100:00100000:3.0:1789117341.041865:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:5614:x1876025362351872:12345-192.168.206.37@tcp:502: 00000100:00100000:3.0:1789117341.042200:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:5614:x1876025362351872:12345-192.168.206.37@tcp:502: Request processed in 336us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117341.042209:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 125 00000100:00100000:2.0:1789117341.046719:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117341.046755:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362352000 00000100:00100000:2.0:1789117341.046764:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362352000 00000100:00100000:2.0:1789117341.046807:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 126 00000100:00100000:2.0:1789117341.046817:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:5614:x1876025362352000:12345-192.168.206.37@tcp:502: 00000100:00100000:2.0:1789117341.047004:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:5614:x1876025362352000:12345-192.168.206.37@tcp:502: Request processed in 187us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117341.047012:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 126 00000100:00100000:0.0:1789117341.051649:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117341.051818:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362352128 00000100:00100000:2.0:1789117341.051826:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362352128 00000100:00100000:2.0:1789117341.051870:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 4 00000100:00100000:2.0:1789117341.051877:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179305d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1876025362352128:12345-192.168.206.37@tcp:38: 00010000:00080000:2.0:1789117341.051905:0:5839:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:2.0:1789117341.052052:0:5839:0:(genops.c:1385:class_connect()) connect: client e0c4e520-7af6-449d-969f-b46035974613, cookie 0xf7565228e460dbfb 00000004:00100000:2.0:1789117341.052079:0:5839:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789117341.052085:0:5839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1789117341.107960:0:5839:0:(import.c:65:import_set_state_nolock()) ffff9c17b8bee000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789117341.108227:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179305d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2348:x1876025362352128:12345-192.168.206.37@tcp:38: Request processed in 56347us (56585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117341.108306:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 4 00010000:00010000:2.0:1789117341.512369:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117342.133164:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117342.133982:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362352256 00000100:00100000:1.0:1789117342.133988:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117342.133994:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362352256 00000100:00080000:1.0:1789117342.134025:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117342.134053:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362352384 00000100:00100000:0.0:1789117342.134057:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362352384 00000100:00100000:1.0:1789117342.134072:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 5 00000100:00100000:1.0:1789117342.134086:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+7:0:x1876025362352256:12345-192.168.206.37@tcp:41: 00000004:00000024:1.0:1789117342.134125:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789117342.134192:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+7:0:x1876025362352256:12345-192.168.206.37@tcp:41: Request processed in 110us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117342.144074:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 6 00000100:00100000:0.0:1789117342.144100:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+7:5591:x1876025362352384:12345-192.168.206.37@tcp:41: 00000004:00000024:0.0:1789117342.144144:0:7242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789117342.144220:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+7:5591:x1876025362352384:12345-192.168.206.37@tcp:41: Request processed in 133us (10237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117342.144228:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 6 00000100:00100000:1.0:1789117342.147115:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 5 00000100:00100000:1.0:1789117342.147712:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117342.147818:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362352512 00000100:00100000:3.0:1789117342.147826:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362352512 00000100:00100000:3.0:1789117342.147871:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 7 00000100:00100000:3.0:1789117342.147880:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+6:5591:x1876025362352512:12345-192.168.206.37@tcp:40: 00000100:00100000:3.0:1789117342.148006:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+6:5591:x1876025362352512:12345-192.168.206.37@tcp:40: Request processed in 126us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117342.148015:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 7 00000100:00100000:3.0:1789117342.159196:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117342.159311:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117342.159345:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117342.159384:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117342.159450:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362353024 00000100:00100000:3.0:1789117342.159458:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362353024 00000100:00100000:3.0:1789117342.159505:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 127 00000100:00100000:3.0:1789117342.159515:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2351:x1876025362353024:12345-192.168.206.37@tcp:400: 00000100:00100000:3.0:1789117342.159579:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2351:x1876025362353024:12345-192.168.206.37@tcp:400: Request processed in 65us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117342.159587:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 127 00000100:00100000:0.0:1789117342.160084:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362352640 00000100:00100000:0.0:1789117342.160090:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362352640 00000100:00100000:0.0:1789117342.160117:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362352768 00000100:00100000:0.0:1789117342.160121:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362352768 00000100:00100000:0.0:1789117342.160134:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 8 00000100:00100000:0.0:1789117342.160139:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1876025362352640:12345-192.168.206.37@tcp:8: 00010000:00080000:0.0:1789117342.160163:0:6685:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:0.0:1789117342.160190:0:6685:0:(genops.c:1385:class_connect()) connect: client e0c4e520-7af6-449d-969f-b46035974613, cookie 0xf7565228e460dc02 00002000:00100000:0.0:1789117342.160201:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e0c4e520-7af6-449d-969f-b46035974613/ffff9c1787d49000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789117342.160220:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789117342.160546:0:6685:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789117342.160572:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9c1787d4c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789117342.160612:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2348:x1876025362352640:12345-192.168.206.37@tcp:8: Request processed in 471us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117342.160619:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 8 00000100:00100000:0.0:1789117342.160632:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 9 00000100:00100000:0.0:1789117342.160636:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1876025362352768:12345-192.168.206.37@tcp:8: 00010000:00080000:0.0:1789117342.160651:0:6685:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:0.0:1789117342.160667:0:6685:0:(genops.c:1385:class_connect()) connect: client e0c4e520-7af6-449d-969f-b46035974613, cookie 0xf7565228e460dc09 00002000:00100000:0.0:1789117342.160672:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e0c4e520-7af6-449d-969f-b46035974613/ffff9c1787d4c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789117342.160696:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789117342.161053:0:6685:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789117342.161073:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9c1787d4d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789117342.161098:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2348:x1876025362352768:12345-192.168.206.37@tcp:8: Request processed in 460us (1752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117342.161105:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 9 00000100:00100000:2.0:1789117342.161971:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362352896 00000100:00100000:2.0:1789117342.161978:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362352896 00000100:00100000:2.0:1789117342.162115:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 0 00000100:00100000:2.0:1789117342.162124:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+6:5591:x1876025362352896:12345-192.168.206.37@tcp:33: 00000004:00080000:2.0:1789117342.203286:0:5842:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 41112us 00000004:00200000:2.0:1789117342.243132:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1789117342.243520:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+6:5591:x1876025362352896:12345-192.168.206.37@tcp:33: Request processed in 81391us (84327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117342.243718:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 0 00010000:00010000:2.0:1789117342.535184:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117342.624070:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117342.624655:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362353152 00000100:00100000:2.0:1789117342.624663:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362353152 00000100:00100000:2.0:1789117342.624835:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 8 00000100:00100000:2.0:1789117342.624846:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+6:5631:x1876025362353152:12345-192.168.206.37@tcp:101: 00010000:00010000:2.0:1789117342.624864:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117342.624888:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460dc10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c6b8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117342.625102:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460dc17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117342.625116:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460dc17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117342.625130:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460dc17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117342.625588:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1789117342.625593:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789117342.625845:0:5839:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460dc17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117342.625872:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460dc10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6b8 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117342.625899:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460dc17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6b8 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117342.625907:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1783e89900) 00010000:00010000:2.0:1789117342.625910:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789117342.625913:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457fa00, rc 0) 00000100:00100000:2.0:1789117342.626189:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+7:5631:x1876025362353152:12345-192.168.206.37@tcp:101: Request processed in 1343us (2127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117342.626204:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 8 00010000:00010000:2.0:1789117343.557621:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117344.326795:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385442176:0@lo:400: 00000100:00100000:2.0:1789117344.326883:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117344.326951:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876025385442688:0@lo:400: 00000100:00100000:2.0:1789117344.326980:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117344.327009:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117344.327015:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385442560:0@lo:400: 00000100:00100000:2.0:1789117344.327039:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117344.327080:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385442688 00000100:00100000:2.0:1789117344.327089:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385442688 00000100:00100000:2.0:1789117344.327316:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789117344.327327:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876025385442688:12345-0@lo:400: 00000100:00100000:2.0:1789117344.327381:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876025385442688:12345-0@lo:400: Request processed in 57us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117344.327390:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789117344.327471:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876025385442688:0@lo:400: 00000100:00100000:3.0:1789117344.327646:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385442304:0@lo:400: 00000100:00100000:3.0:1789117344.327676:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117344.327713:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17a7d7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385442816:0@lo:400: 00000100:00100000:3.0:1789117344.327733:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117344.327749:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117344.327753:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385442432:0@lo:400: 00000100:00100000:3.0:1789117344.327775:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789117344.327856:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117344.327870:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385442560 00000100:00100000:1.0:1789117344.327874:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385442560 00000100:00100000:1.0:1789117344.327916:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385442816 00000100:00100000:1.0:1789117344.327919:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385442816 00000100:00100000:1.0:1789117344.327933:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789117344.327949:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385442560:12345-0@lo:400: 00000100:00100000:1.0:1789117344.327985:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385442560:12345-0@lo:400: Request processed in 37us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117344.327991:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789117344.328003:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789117344.328008:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385442816:12345-0@lo:400: 00000100:00100000:1.0:1789117344.328043:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385442816:12345-0@lo:400: Request processed in 35us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117344.328049:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789117344.328077:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385442304 00000100:00100000:1.0:1789117344.328080:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385442304 00000100:00100000:1.0:1789117344.328096:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385442432 00000100:00100000:1.0:1789117344.328098:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385442432 00000100:00100000:1.0:1789117344.328111:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789117344.328117:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385442304:12345-0@lo:400: 00000100:00100000:1.0:1789117344.328313:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385442304:12345-0@lo:400: Request processed in 195us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117344.328319:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789117344.328330:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789117344.328336:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385442432:12345-0@lo:400: 00000100:00100000:1.0:1789117344.328358:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385442432:12345-0@lo:400: Request processed in 23us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117344.328363:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789117344.328391:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385442432:0@lo:400: 00000100:00100000:1.0:1789117344.328422:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385442304:0@lo:400: 00010000:00080000:1.0:1789117344.328434:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17a7d7b840 x1876025385442816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117344.328444:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789117344.328465:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17a7d7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385442816:0@lo:400: 00000100:00080000:3.0:1789117344.328615:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117344.328619:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789117344.328621:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789117344.328679:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c179305da40 x1876025385442560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117344.328700:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385442560:0@lo:400: 00000100:00100000:0.0:1789117344.328777:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385442176 00000100:00100000:0.0:1789117344.328782:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385442176 00000100:00100000:0.0:1789117344.328818:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789117344.328825:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3299:x1876025385442176:12345-0@lo:400: 00000100:00100000:0.0:1789117344.328871:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3299:x1876025385442176:12345-0@lo:400: Request processed in 47us (1990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117344.328878:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789117344.329029:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385442176:0@lo:400: 00010000:00010000:2.0:1789117344.581853:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117344.838757:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385442944:0@lo:13: 00000100:00100000:2.0:1789117344.838868:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117344.838971:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385442944 00000100:00100000:2.0:1789117344.838980:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385442944 00000100:00100000:3.0:1789117344.839109:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117344.839123:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385443072:0@lo:13: 00000100:00100000:3.0:1789117344.839155:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117344.839187:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385443072 00000100:00100000:3.0:1789117344.839191:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385443072 00000100:00100000:3.0:1789117344.839245:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789117344.839255:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385443072:12345-0@lo:13: 00002000:00000024:3.0:1789117344.839297:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117344.839347:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385443072:12345-0@lo:13: Request processed in 92us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117344.839355:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789117344.839396:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b86aa580 x1876025385443072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117344.839450:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385443072:0@lo:13: 00000100:00100000:2.0:1789117344.840130:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789117344.840140:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385442944:12345-0@lo:13: 00002000:00000024:2.0:1789117344.840172:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789117344.842031:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385442944:12345-0@lo:13: Request processed in 1883us (3152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117344.842046:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789117344.850893:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b87ea940 x1876025385442944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117344.851145:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385442944:0@lo:13: 00000100:00100000:3.0:1789117345.211837:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117345.213389:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362353280 00000100:00100000:1.0:1789117345.213465:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362353280 00000100:00100000:1.0:1789117345.213636:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 9 00000100:00100000:1.0:1789117345.213650:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+7:5684:x1876025362353280:12345-192.168.206.37@tcp:41: 00000004:00000024:1.0:1789117345.213715:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789117345.213809:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+7:5684:x1876025362353280:12345-192.168.206.37@tcp:41: Request processed in 162us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117345.213818:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 9 00000100:00080000:3.0:1789117345.215723:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117345.222049:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117345.222176:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362353408 00000100:00100000:2.0:1789117345.222189:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362353408 00000100:00100000:2.0:1789117345.222287:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 8 00000100:00100000:2.0:1789117345.222301:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e0c4e520-7af6-449d-969f-b46035974613+6:5684:x1876025362353408:12345-192.168.206.37@tcp:13: 00002000:00000024:2.0:1789117345.222337:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789117345.222483:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e0c4e520-7af6-449d-969f-b46035974613+6:5684:x1876025362353408:12345-192.168.206.37@tcp:13: Request processed in 184us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117345.222492:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 8 00000100:00080000:3.0:1789117345.222575:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117345.230158:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117345.230562:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362353536 00000100:00100000:2.0:1789117345.230576:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362353536 00000100:00100000:2.0:1789117345.230679:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 9 00000100:00100000:2.0:1789117345.230702:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e0c4e520-7af6-449d-969f-b46035974613+6:5684:x1876025362353536:12345-192.168.206.37@tcp:13: 00002000:00000024:2.0:1789117345.230738:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789117345.230936:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117345.231179:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e0c4e520-7af6-449d-969f-b46035974613+6:5684:x1876025362353536:12345-192.168.206.37@tcp:13: Request processed in 479us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117345.231197:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 9 00010000:00010000:2.0:1789117345.615201:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789117345.951951:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e0c4e520-7af6-449d-969f-b46035974613 00000001:00100000:0.0:1789117346.445914:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e0c4e520-7af6-449d-969f-b46035974613 00000001:00100000:1.0:1789117346.458187:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e0c4e520-7af6-449d-969f-b46035974613 00010000:00010000:2.0:1789117346.630567:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117347.480304:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117347.480369:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117347.480448:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117347.480490:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117347.480526:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362353792 00000100:00100000:0.0:1789117347.480537:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362353792 00000100:00100000:0.0:1789117347.480615:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 20 00000100:00100000:0.0:1789117347.480627:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362353792:12345-192.168.206.37@tcp:400: 00000100:00100000:0.0:1789117347.480734:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362353792:12345-192.168.206.37@tcp:400: Request processed in 108us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117347.480764:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 20 00000100:00100000:1.0:1789117347.480790:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362353920 00000100:00100000:1.0:1789117347.480803:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362353920 00000100:00100000:0.0:1789117347.480804:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362354048 00000100:00100000:0.0:1789117347.480810:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362354048 00000100:00100000:0.0:1789117347.480855:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 6 00000100:00100000:1.0:1789117347.480862:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789117347.480868:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+5:2351:x1876025362354048:12345-192.168.206.37@tcp:400: 00000100:00100000:1.0:1789117347.480875:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789117347.480997:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 7 00000100:00100000:1.0:1789117347.481007:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+5:2351:x1876025362353920:12345-192.168.206.37@tcp:400: 00000100:00100000:1.0:1789117347.481079:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+5:2351:x1876025362353920:12345-192.168.206.37@tcp:400: Request processed in 73us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117347.481086:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 7 00000100:00100000:3.0:1789117347.481278:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362353664 00000100:00100000:3.0:1789117347.481284:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362353664 00000100:00100000:3.0:1789117347.481321:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 129 00000100:00100000:3.0:1789117347.481329:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2351:x1876025362353664:12345-192.168.206.37@tcp:400: 00000100:00100000:3.0:1789117347.481378:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2351:x1876025362353664:12345-192.168.206.37@tcp:400: Request processed in 49us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117347.481385:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 129 00000100:00100000:0.0:1789117347.481507:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+5:2351:x1876025362354048:12345-192.168.206.37@tcp:400: Request processed in 643us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117347.481516:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 6 00000100:00080000:0.0:1789117347.481538:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117347.481543:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789117347.481546:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789117347.653913:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789117348.466300:0:8302:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789117348.681066:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117349.447179:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17a7d78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385443200:0@lo:400: 00000100:00100000:3.0:1789117349.447268:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117349.447323:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17a7d78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876025385443712:0@lo:400: 00000100:00100000:3.0:1789117349.447350:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117349.447378:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117349.447384:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17a7d7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385443584:0@lo:400: 00000100:00100000:3.0:1789117349.447429:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117349.447457:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385443712 00000100:00100000:3.0:1789117349.447464:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385443712 00000100:00100000:3.0:1789117349.447511:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789117349.447520:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876025385443712:12345-0@lo:400: 00000100:00100000:3.0:1789117349.447569:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876025385443712:12345-0@lo:400: Request processed in 50us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117349.447576:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789117349.447613:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17a7d78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876025385443712:0@lo:400: 00000100:00100000:0.0:1789117349.447818:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385443200 00000100:00100000:0.0:1789117349.447822:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385443200 00000100:00100000:0.0:1789117349.447854:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789117349.447861:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3299:x1876025385443200:12345-0@lo:400: 00000100:00100000:0.0:1789117349.447897:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3299:x1876025385443200:12345-0@lo:400: Request processed in 37us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117349.447903:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1789117349.447931:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117349.448026:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17a7d7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876025385443456:0@lo:400: 00000100:00100000:1.0:1789117349.448054:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117349.448074:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789117349.448080:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17a7d78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385443328:0@lo:400: 00000100:00100000:1.0:1789117349.448101:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117349.448116:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17a7d79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385443840:0@lo:400: 00000100:00100000:1.0:1789117349.448150:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117349.448173:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385443584 00000100:00100000:1.0:1789117349.448176:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385443584 00000100:00100000:1.0:1789117349.448219:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385443840 00000100:00100000:1.0:1789117349.448222:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385443840 00000100:00100000:1.0:1789117349.448243:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789117349.448249:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385443584:12345-0@lo:400: 00000100:00100000:1.0:1789117349.448280:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385443584:12345-0@lo:400: Request processed in 30us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117349.448286:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789117349.448298:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789117349.448303:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385443840:12345-0@lo:400: 00000100:00100000:1.0:1789117349.448332:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385443840:12345-0@lo:400: Request processed in 29us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117349.448337:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789117349.448354:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117349.448357:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789117349.448375:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17a7d79a40 x1876025385443840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117349.448386:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17a7d79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385443840:0@lo:400: 00000100:00100000:0.0:1789117349.448582:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385443456 00000100:00100000:0.0:1789117349.448587:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385443456 00000100:00100000:0.0:1789117349.448630:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385443328 00000100:00100000:0.0:1789117349.448633:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385443328 00000100:00100000:0.0:1789117349.448646:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789117349.448652:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876025385443456:12345-0@lo:400: 00000100:00100000:0.0:1789117349.448701:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876025385443456:12345-0@lo:400: Request processed in 49us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117349.448713:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789117349.448726:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789117349.448732:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385443328:12345-0@lo:400: 00000100:00100000:0.0:1789117349.448760:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385443328:12345-0@lo:400: Request processed in 28us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117349.448766:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789117349.448797:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17a7d78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385443328:0@lo:400: 00000100:00100000:0.0:1789117349.448807:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17a7d7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876025385443456:0@lo:400: 00000100:00080000:1.0:1789117349.449378:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789117349.449910:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17a7d7ad00 x1876025385443584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117349.449934:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17a7d7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385443584:0@lo:400: 00000100:00100000:3.0:1789117349.449947:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17a7d78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385443200:0@lo:400: 00010000:00010000:3.0:1789117349.702084:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117349.957883:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117349.957916:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385443968:0@lo:13: 00000100:00100000:3.0:1789117349.958020:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117349.958111:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385443968 00000100:00100000:3.0:1789117349.958120:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385443968 00000100:00100000:3.0:1789117349.958185:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789117349.958196:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385443968:12345-0@lo:13: 00002000:00000024:3.0:1789117349.958244:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117349.958297:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385443968:12345-0@lo:13: Request processed in 103us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117349.958305:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789117349.958355:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b86a8000 x1876025385443968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117349.958375:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385443968:0@lo:13: 00000100:00100000:0.0:1789117349.959115:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17a7d7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385444096:0@lo:13: 00000100:00100000:0.0:1789117349.959161:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117349.959221:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385444096 00000100:00100000:0.0:1789117349.959226:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385444096 00000100:00100000:0.0:1789117349.959258:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789117349.959265:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385444096:12345-0@lo:13: 00002000:00000024:0.0:1789117349.959293:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789117349.959336:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385444096:12345-0@lo:13: Request processed in 70us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117349.959344:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789117349.959385:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17a7d7a940 x1876025385444096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117349.959429:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17a7d7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385444096:0@lo:13: 00010000:00010000:2.0:1789117350.733858:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117351.754194:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117352.611428:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117352.611487:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117352.611510:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117352.611563:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117352.611639:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362354304 00000100:00100000:3.0:1789117352.611659:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362354304 00000100:00100000:1.0:1789117352.611777:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362354432 00000100:00100000:1.0:1789117352.611781:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362354432 00000100:00100000:2.0:1789117352.611803:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362354176 00000100:00100000:2.0:1789117352.611806:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362354176 00000100:00100000:2.0:1789117352.611849:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 131 00000100:00100000:2.0:1789117352.611858:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2349:x1876025362354176:12345-192.168.206.37@tcp:400: 00000100:00100000:3.0:1789117352.611865:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 24 00000100:00100000:3.0:1789117352.611871:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2349:x1876025362354304:12345-192.168.206.37@tcp:400: 00000100:00100000:3.0:1789117352.613973:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2349:x1876025362354304:12345-192.168.206.37@tcp:400: Request processed in 2091us (2450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117352.613985:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 24 00000100:00080000:0.0:1789117352.614587:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789117352.614593:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117352.614757:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362354560 00000100:00100000:0.0:1789117352.614765:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362354560 00000100:00100000:0.0:1789117352.616740:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 10 00000100:00100000:0.0:1789117352.616765:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+5:2349:x1876025362354560:12345-192.168.206.37@tcp:400: 00000100:00100000:1.0:1789117352.616909:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 11 00000100:00100000:1.0:1789117352.616918:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+5:2349:x1876025362354432:12345-192.168.206.37@tcp:400: 00000100:00100000:2.0:1789117352.618395:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2349:x1876025362354176:12345-192.168.206.37@tcp:400: Request processed in 6531us (6986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117352.618419:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 131 00000100:00080000:3.0:1789117352.618706:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789117352.622175:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+5:2349:x1876025362354560:12345-192.168.206.37@tcp:400: Request processed in 5412us (10600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117352.622189:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 10 00000100:00100000:1.0:1789117352.628539:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+5:2349:x1876025362354432:12345-192.168.206.37@tcp:400: Request processed in 11610us (17039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117352.628567:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 11 00010000:00010000:2.0:1789117352.776171:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117353.800937:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789117354.054754:0:8451:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebb685730 20000000:00000080:2.0:1789117354.054771:0:8451:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c1681d58400 uarg=0000000000000000 20000000:01000000:2.0:1789117354.054867:0:8451:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789117354.054869:0:8451:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789117354.054871:0:8451:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789117354.054876:0:8451:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789117354.054881:0:8451:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789117354.054894:0:8451:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789117354.054896:0:8451:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789117354.055065:0:8451:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789117354.055068:0:8451:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789117354.061753:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1789117354.064320:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1789117354.064448:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1789117354.069502:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1789117354.069537:0:8451:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789117354.069540:0:8451:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789117354.073811:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1789117354.074360:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1789117354.074447:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1789117354.074807:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1789117354.074823:0:8451:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789117354.074826:0:8451:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789117354.081563:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789117354.084747:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789117354.084817:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1789117354.084856:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1789117354.084870:0:8451:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789117354.084872:0:8451:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789117354.091008:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1789117354.091800:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1789117354.091853:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1789117354.091920:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:3.0:1789117354.091936:0:8451:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789117354.091954:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c178149da00/0xf7565228e460dc1e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.091969:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1781685600/0xf7565228e460db1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460db14 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.091977:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178457e200/0xf7565228e460db45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460db3e expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.092304:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178457e000/0xf7565228e460db6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460db68 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.092311:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178149de00/0xf7565228e460db7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460db76 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.092318:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1781685200/0xf7565228e460db8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460db84 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.092324:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178457ee00/0xf7565228e460dba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dba0 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.092344:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178457fe00/0xf7565228e460dbd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dbca expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.092354:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178457ea00/0xf7565228e460dbdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c656 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.092361:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178149ca00/0xf7565228e460dbe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c65d expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.092369:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c178149da00/0xf7565228e460dc1e lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.092432:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178149ca00/0xf7565228e460dbe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c65d expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.092448:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c178149ca00/0xf7565228e460dbe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c65d expref: 9 pid: 5833 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117354.092464:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876025385444224:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117354.092616:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178457ea00/0xf7565228e460dbdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c656 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.092625:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c178457ea00/0xf7565228e460dbdf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c656 expref: 9 pid: 5834 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117354.092644:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be71e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876025385444352:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117354.092685:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178457fe00/0xf7565228e460dbd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460dbca expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.092705:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c178457fe00/0xf7565228e460dbd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460dbca expref: 18 pid: 5833 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117354.092715:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be70f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876025385444480:0@lo:104: 00000100:00100000:3.0:1789117354.092766:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117354.092816:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178457ee00/0xf7565228e460dba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460dba0 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.092823:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c178457ee00/0xf7565228e460dba7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460dba0 expref: 18 pid: 5833 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117354.092830:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f65e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876025385444608:0@lo:104: 00000100:00100000:3.0:1789117354.092851:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117354.092868:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1781685200/0xf7565228e460db8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460db84 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.092875:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1781685200/0xf7565228e460db8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460db84 expref: 18 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117354.092883:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f652c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876025385444736:0@lo:104: 00000100:00100000:1.0:1789117354.093278:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789117354.093292:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385444480 00000100:00100000:1.0:1789117354.093297:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385444480 00000100:00100000:1.0:1789117354.093331:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385444608 00000100:00100000:1.0:1789117354.093333:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385444608 00000100:00100000:1.0:1789117354.093348:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789117354.093357:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f65a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+4:8451:x1876025385444480:12345-0@lo:104: 00010000:00010000:1.0:1789117354.093371:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c178457e800/0xf7565228e460dbca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dbd1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.093458:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789117354.093464:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f65a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+4:8451:x1876025385444480:12345-0@lo:104: Request processed in 108us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117354.093471:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789117354.093487:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789117354.093494:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:8451:x1876025385444608:12345-0@lo:104: 00010000:00010000:1.0:1789117354.093502:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460dba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dba7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.093535:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789117354.093539:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:8451:x1876025385444608:12345-0@lo:104: Request processed in 47us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117354.093557:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1789117354.093604:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789117354.093609:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c178457e800/0xf7565228e460dbca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dbd1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.093616:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e800 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:1.0:1789117354.093620:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c178457e800/0xf7565228e460dbca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460dbd1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.093628:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178457e800/0xf7565228e460dbca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460dbd1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117354.093647:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178457e800/0xf7565228e460dbca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460dbd1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117354.093653:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789117354.093687:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c178457e800/0xf7565228e460dbca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dbd1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.093693:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117354.093716:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c178457e800/0xf7565228e460dbca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dbd1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.093723:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178457e800/0xf7565228e460dbca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dbd1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.093735:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117354.093738:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460dba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dba7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.093754:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457fc00 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:1.0:1789117354.093758:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460dba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460dba7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.093765:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460dba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460dba7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117354.093771:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460dba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460dba7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117354.093777:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789117354.093791:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460dba0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dba7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.093796:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117354.093810:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460dba0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dba7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.093817:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460dba0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dba7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.093826:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117354.093827:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117354.093829:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117354.093835:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117354.093842:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117354.093866:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385444864:0@lo:103: 00000100:00100000:1.0:1789117354.093896:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117354.093933:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385444992:0@lo:103: 00000100:00100000:1.0:1789117354.094159:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117354.094193:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385444864 00000100:00100000:1.0:1789117354.094197:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385444864 00010000:00010000:1.0:1789117354.094215:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178457fe00/0xf7565228e460dbd1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dbca expref: 19 pid: 5833 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117354.094249:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385444992 00000100:00100000:1.0:1789117354.094253:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385444992 00010000:00010000:1.0:1789117354.094264:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178457ee00/0xf7565228e460dba7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dba0 expref: 20 pid: 5833 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117354.094283:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789117354.094289:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+20:3298:x1876025385444864:12345-0@lo:103: 00010000:00010000:1.0:1789117354.094299:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117354.094304:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178457fe00/0xf7565228e460dbd1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dbca expref: 20 pid: 5833 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.094313:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178457fe00/0xf7565228e460dbd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460dbca expref: 20 pid: 5833 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.094327:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117354.094356:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+20:3298:x1876025385444864:12345-0@lo:103: Request processed in 67us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117354.094362:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789117354.094376:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789117354.094382:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385444992:12345-0@lo:103: 00010000:00010000:1.0:1789117354.094389:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117354.094394:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178457ee00/0xf7565228e460dba7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dba0 expref: 19 pid: 5833 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.094508:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178457ee00/0xf7565228e460dba7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460dba0 expref: 19 pid: 5833 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.094518:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117354.094547:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385444992:12345-0@lo:103: Request processed in 164us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117354.094553:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789117354.094592:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385444992:0@lo:103: 00000100:00100000:1.0:1789117354.094616:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385444864:0@lo:103: 00000100:00100000:3.0:1789117354.094789:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117354.094829:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178149de00/0xf7565228e460db7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460db76 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.094840:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c178149de00/0xf7565228e460db7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460db76 expref: 18 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117354.094850:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f67480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876025385445120:0@lo:104: 00000100:00100000:3.0:1789117354.094880:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117354.095440:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178457e000/0xf7565228e460db6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460db68 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.095451:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c178457e000/0xf7565228e460db6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460db68 expref: 18 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117354.095460:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f66580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876025385445248:0@lo:104: 00000100:00100000:1.0:1789117354.095538:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385444736 00000100:00100000:1.0:1789117354.095544:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385444736 00000100:00100000:1.0:1789117354.095566:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385445120 00000100:00100000:1.0:1789117354.095569:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385445120 00000100:00100000:1.0:1789117354.095580:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789117354.095587:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+4:8451:x1876025385444736:12345-0@lo:104: 00000100:00100000:3.0:1789117354.097083:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117354.097124:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178457e200/0xf7565228e460db45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460db3e expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.097137:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c178457e200/0xf7565228e460db45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460db3e expref: 18 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117354.097148:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f670c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876025385445376:0@lo:104: 00000100:00100000:3.0:1789117354.097171:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117354.097188:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1781685600/0xf7565228e460db1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460db14 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.097197:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1781685600/0xf7565228e460db1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460db14 expref: 18 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117354.097204:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f67c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876025385445504:0@lo:104: 00000100:00100000:3.0:1789117354.097223:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117354.097233:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a97640c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789117354.097251:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178457fe00/0xf7565228e460dbd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460dbca expref: 18 pid: 5833 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117354.097263:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be70f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876025385444480:0@lo:104: 00010000:00010000:3.0:1789117354.097286:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178457ee00/0xf7565228e460dba7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460dba0 expref: 17 pid: 5833 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117354.097295:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f65e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876025385444608:0@lo:104: 00010000:00010000:1.0:1789117354.102091:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460db84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460db8b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.102200:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789117354.102209:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+4:8451:x1876025385444736:12345-0@lo:104: Request processed in 6620us (7418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117354.102220:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789117354.102249:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385445248 00000100:00100000:1.0:1789117354.102255:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385445248 00000100:00100000:1.0:1789117354.102511:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385445376 00000100:00100000:1.0:1789117354.102515:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385445376 00000100:00100000:1.0:1789117354.102524:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385445504 00000100:00100000:1.0:1789117354.102537:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385445504 00000100:00100000:1.0:1789117354.102552:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789117354.102559:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f67840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+6:8451:x1876025385445120:12345-0@lo:104: 00010000:00010000:1.0:1789117354.102569:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c1781684c00/0xf7565228e460db76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460db7d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.102608:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789117354.102613:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f67840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+6:8451:x1876025385445120:12345-0@lo:104: Request processed in 55us (7733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117354.102619:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789117354.102631:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789117354.102651:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+5:8451:x1876025385445248:12345-0@lo:104: 00010000:00010000:1.0:1789117354.102659:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c1781685400/0xf7565228e460db68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460db6f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.102696:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789117354.102701:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+5:8451:x1876025385445248:12345-0@lo:104: Request processed in 66us (5623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117354.102707:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789117354.102719:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789117354.102725:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f65680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+4:8451:x1876025385445376:12345-0@lo:104: 00010000:00010000:1.0:1789117354.102732:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c178149d800/0xf7565228e460db3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460db45 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.102757:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789117354.102762:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f65680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+4:8451:x1876025385445376:12345-0@lo:104: Request processed in 38us (5591us total) trans 0 rc 0/0 00010000:00010000:2.0:1789117354.102866:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789117354.102873:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460db84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460db8b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.102880:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1780030800 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:2.0:1789117354.102884:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460db84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460db8b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.102892:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460db84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460db8b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117354.102899:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460db84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460db8b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117354.102905:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789117354.102942:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460db84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460db8b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.102949:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117354.102965:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460db84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460db8b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.102994:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c1780030800/0xf7565228e460db84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460db8b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.103009:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789117354.103013:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c1781684c00/0xf7565228e460db76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460db7d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.103018:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781684c00 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:2.0:1789117354.103021:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c1781684c00/0xf7565228e460db76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460db7d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.103028:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c1781684c00/0xf7565228e460db76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460db7d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117354.103035:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c1781684c00/0xf7565228e460db76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460db7d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117354.103040:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789117354.103054:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c1781684c00/0xf7565228e460db76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460db7d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.103061:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117354.103073:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c1781684c00/0xf7565228e460db76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460db7d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.103081:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c1781684c00/0xf7565228e460db76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460db7d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.103090:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789117354.103093:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1789117354.103099:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c1781685400/0xf7565228e460db68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460db6f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.103108:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685400 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:2.0:1789117354.103111:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c1781685400/0xf7565228e460db68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460db6f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117354.103118:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789117354.103120:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c1781685400/0xf7565228e460db68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460db6f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117354.103127:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f643c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:8451:x1876025385445504:12345-0@lo:104: 00010000:00010000:1.0:1789117354.103137:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c178149cc00/0xf7565228e460db14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460db1b expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117354.103140:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c1781685400/0xf7565228e460db68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460db6f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117354.103152:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789117354.103171:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c1781685400/0xf7565228e460db68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460db6f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.103174:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789117354.103181:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789117354.103182:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f643c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:8451:x1876025385445504:12345-0@lo:104: Request processed in 57us (5957us total) trans 0 rc 0/0 00010000:00010000:2.0:1789117354.103189:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c1781685400/0xf7565228e460db68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460db6f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117354.103190:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789117354.103200:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c1781685400/0xf7565228e460db68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460db6f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.103212:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789117354.103216:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385445632:0@lo:103: 00010000:00010000:2.0:1789117354.103217:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c178149d800/0xf7565228e460db3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460db45 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.103228:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178149d800 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:2.0:1789117354.103232:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c178149d800/0xf7565228e460db3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460db45 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.103250:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178149d800/0xf7565228e460db3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460db45 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117354.103251:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1789117354.103261:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178149d800/0xf7565228e460db3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460db45 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117354.103267:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789117354.103281:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c178149d800/0xf7565228e460db3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460db45 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.103286:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117354.103292:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c178149d800/0xf7565228e460db3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460db45 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.103298:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178149d800/0xf7565228e460db3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460db45 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.103308:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117354.103311:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c178149cc00/0xf7565228e460db14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460db1b expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.103317:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178149cc00 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:2.0:1789117354.103320:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c178149cc00/0xf7565228e460db14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460db1b expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.103327:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178149cc00/0xf7565228e460db14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460db1b expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117354.103334:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178149cc00/0xf7565228e460db14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460db1b expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117354.103345:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789117354.103359:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c178149cc00/0xf7565228e460db14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460db1b expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.103364:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117354.103369:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c178149cc00/0xf7565228e460db14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460db1b expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.103375:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178149cc00/0xf7565228e460db14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460db1b expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117354.103389:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117354.103391:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117354.103393:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117354.103395:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385446144:0@lo:103: 00000100:00100000:2.0:1789117354.103432:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385445888:0@lo:103: 00000100:00100000:1.0:1789117354.103441:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117354.103461:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789117354.103467:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385446016:0@lo:103: 00000100:00100000:2.0:1789117354.103481:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117354.103501:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385445632 00000100:00100000:1.0:1789117354.103506:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385445632 00000100:00100000:2.0:1789117354.103515:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117354.103523:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385445760:0@lo:103: 00010000:00010000:1.0:1789117354.103526:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1781685200/0xf7565228e460db8b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460db84 expref: 17 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117354.103552:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117354.103553:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385446144 00000100:00100000:1.0:1789117354.103557:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385446144 00010000:00010000:1.0:1789117354.103571:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1781685600/0xf7565228e460db1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460db14 expref: 18 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117354.103582:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385445888 00000100:00100000:1.0:1789117354.103584:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385445888 00010000:00010000:1.0:1789117354.103591:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178457e000/0xf7565228e460db6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460db68 expref: 19 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117354.103612:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385445760 00000100:00100000:1.0:1789117354.103614:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385445760 00010000:00010000:1.0:1789117354.103623:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178149de00/0xf7565228e460db7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460db76 expref: 20 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117354.103633:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789117354.103745:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+20:3301:x1876025385445632:12345-0@lo:103: 00010000:00010000:1.0:1789117354.103756:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117354.103762:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1781685200/0xf7565228e460db8b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460db84 expref: 20 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.103933:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1781685200/0xf7565228e460db8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460db84 expref: 20 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.103949:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117354.103973:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+20:3301:x1876025385445632:12345-0@lo:103: Request processed in 231us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117354.103980:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789117354.103994:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789117354.103999:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3301:x1876025385446144:12345-0@lo:103: 00010000:00010000:1.0:1789117354.104012:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117354.104017:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1781685600/0xf7565228e460db1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460db14 expref: 19 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.104025:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1781685600/0xf7565228e460db1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460db14 expref: 19 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.104034:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117354.104059:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3301:x1876025385446144:12345-0@lo:103: Request processed in 60us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117354.104065:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789117354.104076:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789117354.104082:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:3299:x1876025385445888:12345-0@lo:103: 00010000:00010000:1.0:1789117354.104088:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117354.104093:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178457e000/0xf7565228e460db6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460db68 expref: 18 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.104101:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178457e000/0xf7565228e460db6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460db68 expref: 18 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.104110:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117354.104137:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:3299:x1876025385445888:12345-0@lo:103: Request processed in 55us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117354.104143:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789117354.104153:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789117354.104158:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:3299:x1876025385445760:12345-0@lo:103: 00010000:00010000:1.0:1789117354.104165:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117354.104169:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178149de00/0xf7565228e460db7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460db76 expref: 17 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.104177:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178149de00/0xf7565228e460db7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460db76 expref: 17 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.104185:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117354.104201:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:3299:x1876025385445760:12345-0@lo:103: Request processed in 43us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117354.104207:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1789117354.104233:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117354.104243:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117354.104480:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385446144:0@lo:103: 00000100:00100000:1.0:1789117354.104496:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385445632:0@lo:103: 00000100:00100000:1.0:1789117354.104525:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385446016 00000100:00100000:1.0:1789117354.104528:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385446016 00010000:00010000:1.0:1789117354.104542:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178457e200/0xf7565228e460db45 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460db3e expref: 17 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117354.104560:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789117354.104565:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17845e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:3301:x1876025385446016:12345-0@lo:103: 00010000:00010000:1.0:1789117354.104572:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117354.104576:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178457e200/0xf7565228e460db45 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460db3e expref: 17 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.104584:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178457e200/0xf7565228e460db45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460db3e expref: 17 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117354.104594:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117354.104617:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17845e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:3301:x1876025385446016:12345-0@lo:103: Request processed in 52us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117354.104623:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789117354.104686:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385446016:0@lo:103: 00000100:00100000:2.0:1789117354.105358:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385445760:0@lo:103: 00000100:00100000:2.0:1789117354.105382:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385445888:0@lo:103: 00010000:00010000:3.0:1789117354.106469:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1781685200/0xf7565228e460db8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460db84 expref: 16 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117354.106487:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f652c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876025385444736:0@lo:104: 00010000:00010000:3.0:1789117354.106498:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178149de00/0xf7565228e460db7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460db76 expref: 15 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117354.106505:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f67480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876025385445120:0@lo:104: 00010000:00010000:3.0:1789117354.106526:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178457e000/0xf7565228e460db6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460db68 expref: 14 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117354.106534:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f66580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876025385445248:0@lo:104: 00010000:00010000:3.0:1789117354.106544:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178457e200/0xf7565228e460db45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460db3e expref: 13 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117354.106551:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f670c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876025385445376:0@lo:104: 00010000:00010000:3.0:1789117354.106559:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1781685600/0xf7565228e460db1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460db14 expref: 12 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117354.106606:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f67c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876025385445504:0@lo:104: 00000100:00100000:2.0:1789117354.113359:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117354.113385:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117354.113826:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362354688 00000100:00100000:0.0:1789117354.113834:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362354688 00010000:00010000:0.0:1789117354.113867:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178149ca00/0xf7565228e460dbe6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c65d expref: 10 pid: 5833 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117354.113907:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362354816 00000100:00100000:0.0:1789117354.113910:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362354816 00010000:00010000:0.0:1789117354.113922:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178457ea00/0xf7565228e460dbdf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c656 expref: 11 pid: 5834 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117354.113940:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 19 00000100:00100000:0.0:1789117354.113948:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:2351:x1876025362354688:12345-192.168.206.37@tcp:103: 00010000:00010000:0.0:1789117354.113960:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117354.113966:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178149ca00/0xf7565228e460dbe6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c65d expref: 11 pid: 5833 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117354.113986:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178149ca00/0xf7565228e460dbe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c65d expref: 11 pid: 5833 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117354.114021:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117354.114067:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:2351:x1876025362354688:12345-192.168.206.37@tcp:103: Request processed in 119us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117354.114074:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 19 00000100:00100000:0.0:1789117354.114098:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 20 00000100:00100000:0.0:1789117354.114105:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2351:x1876025362354816:12345-192.168.206.37@tcp:103: 00010000:00010000:0.0:1789117354.114113:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117354.114118:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178457ea00/0xf7565228e460dbdf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c656 expref: 10 pid: 5834 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117354.114126:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178457ea00/0xf7565228e460dbdf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c656 expref: 10 pid: 5834 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117354.114137:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c178149da00/0xf7565228e460dc1e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117354.114146:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178149da00/0xf7565228e460dc1e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117354.114161:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178149da00/0xf7565228e460dc1e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117354.114167:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178149da00/0xf7565228e460dc1e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117354.114173:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c178149da00/0xf7565228e460dc1e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117354.114181:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c178149da00/0xf7565228e460dc1e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117354.114193:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178149da00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:0.0:1789117354.114197:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c178149da00/0xf7565228e460dc1e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117354.114205:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c178149da00/0xf7565228e460dc1e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117354.114213:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c178149da00/0xf7565228e460dc1e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117354.114223:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117354.114245:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2351:x1876025362354816:12345-192.168.206.37@tcp:103: Request processed in 140us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117354.114252:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 20 00010000:00010000:3.0:1789117354.114937:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178149ca00/0xf7565228e460dbe6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c65d expref: 9 pid: 5833 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117354.114950:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876025385444224:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117354.114970:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178457ea00/0xf7565228e460dbdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c656 expref: 8 pid: 5834 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117354.114990:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be71e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876025385444352:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117354.115030:0:8451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c178149da00/0xf7565228e460dc1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.115038:0:8451:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c178149da00/0xf7565228e460dc1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.115044:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c178149da00/0xf7565228e460dc1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117354.115049:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178149da00/0xf7565228e460dc1e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117354.569387:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117354.570876:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385446400:0@lo:400: 00000100:00100000:2.0:1789117354.570956:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117354.571187:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385446400 00000100:00100000:0.0:1789117354.571194:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385446400 00000100:00100000:2.0:1789117354.571214:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876025385446272:0@lo:400: 00000100:00100000:2.0:1789117354.571244:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117354.571255:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385446272 00000100:00100000:0.0:1789117354.571260:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385446272 00000100:00100000:2.0:1789117354.571292:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789117354.571302:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385446400:12345-0@lo:400: 00000100:00080000:1.0:1789117354.571335:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117354.571354:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385446400:12345-0@lo:400: Request processed in 54us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117354.572449:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789117354.572471:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789117354.572525:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385446400:0@lo:400: 00000100:00100000:2.0:1789117354.572539:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117354.572546:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385446784:0@lo:400: 00000100:00100000:2.0:1789117354.572579:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117354.572714:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385446784 00000100:00100000:0.0:1789117354.572720:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385446784 00000100:00100000:0.0:1789117354.572768:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789117354.572775:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385446784:12345-0@lo:400: 00000100:00080000:2.0:1789117354.572841:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789117354.573880:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385446784:12345-0@lo:400: Request processed in 1102us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117354.577094:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789117354.577559:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b7f652c0 x1876025385446784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117354.577574:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385446784:0@lo:400: 00000100:00100000:0.0:1789117354.579524:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876025385446656:0@lo:400: 00000100:00100000:0.0:1789117354.579593:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117354.579657:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789117354.579665:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385446528:0@lo:400: 00000100:00100000:0.0:1789117354.579691:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117354.579779:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385446656 00000100:00100000:2.0:1789117354.579786:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385446656 00000100:00100000:2.0:1789117354.579841:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789117354.579850:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876025385446656:12345-0@lo:400: 00000100:00080000:0.0:1789117354.579917:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117354.580205:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876025385446656:12345-0@lo:400: Request processed in 354us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117354.580212:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789117354.580297:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385446528 00000100:00100000:1.0:1789117354.580302:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385446528 00000100:00100000:1.0:1789117354.580341:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789117354.580347:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385446528:12345-0@lo:400: 00000100:00100000:1.0:1789117354.580387:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385446528:12345-0@lo:400: Request processed in 40us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117354.580393:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789117354.580429:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876025385446272:12345-0@lo:400: 00000100:00100000:1.0:1789117354.580462:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876025385446272:12345-0@lo:400: Request processed in 7999us (9218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117354.580469:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789117354.581184:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117354.581216:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876025385446272:0@lo:400: 00010000:00080000:0.0:1789117354.581371:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b7f66580 x1876025385446528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117354.581383:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385446528:0@lo:400: 00000100:00100000:0.0:1789117354.581393:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876025385446656:0@lo:400: 00010000:00010000:2.0:1789117354.825833:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117355.077917:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17a7d79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385446912:0@lo:13: 00000100:00100000:2.0:1789117355.077998:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117355.078162:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385446912 00000100:00100000:0.0:1789117355.078169:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385446912 00000100:00100000:0.0:1789117355.078223:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789117355.078233:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385446912:12345-0@lo:13: 00002000:00000024:0.0:1789117355.078266:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789117355.078320:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385446912:12345-0@lo:13: Request processed in 88us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117355.078327:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789117355.078435:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17a7d79a40 x1876025385446912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117355.078452:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17a7d79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385446912:0@lo:13: 00000100:00100000:2.0:1789117355.078693:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385447040:0@lo:13: 00000100:00100000:2.0:1789117355.078719:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117355.078780:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385447040 00000100:00100000:3.0:1789117355.078784:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385447040 00000100:00100000:3.0:1789117355.078812:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789117355.078818:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385447040:12345-0@lo:13: 00002000:00000024:3.0:1789117355.078835:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117355.078871:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385447040:12345-0@lo:13: Request processed in 53us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117355.078876:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789117355.078933:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b87ebc00 x1876025385447040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117355.078946:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385447040:0@lo:13: 00010000:00010000:1.0:1789117355.851038:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789117356.101641:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789117356.101649:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c16816f2800 from 39 10000000:01000000:2.0:1789117356.101654:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789117356.101700:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457ea00/0xf7565228e460dc25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117356.101712:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178457ea00/0xf7565228e460dc25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117356.101723:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178457ea00/0xf7565228e460dc25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117356.101757:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385447168:0@lo:101: 00000100:00100000:2.0:1789117356.101824:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117356.101883:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787c053c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117356.102001:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385447168 00000100:00100000:0.0:1789117356.102008:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385447168 00000100:00100000:0.0:1789117356.102731:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789117356.102743:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+12:5837:x1876025385447168:12345-0@lo:101: 00010000:00010000:0.0:1789117356.102758:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117356.102772:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1780030200/0xf7565228e460dc2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dc25 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117356.102795:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1780030200/0xf7565228e460dc2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dc25 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117356.102806:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1780030200/0xf7565228e460dc2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dc25 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117356.102826:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1780030200, rc 0) 00000100:00100000:0.0:1789117356.103102:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:5837:x1876025385447168:12345-0@lo:101: Request processed in 361us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117356.103109:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789117356.103268:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385447168:0@lo:101: 00010000:00010000:1.0:1789117356.103284:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178457ea00/0xf7565228e460dc25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc2c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117356.103293:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178457ea00/0xf7565228e460dc25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dc2c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117356.103349:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385447296:0@lo:501: 00000100:00100000:1.0:1789117356.103380:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117356.103427:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17882576c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117356.103442:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385447296 00000100:00100000:1.0:1789117356.103446:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385447296 00000100:00100000:1.0:1789117356.103472:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789117356.103479:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:5837:x1876025385447296:12345-0@lo:501: 00000100:00100000:1.0:1789117356.104235:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:5837:x1876025385447296:12345-0@lo:501: Request processed in 754us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117356.104243:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789117356.104874:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385447296:0@lo:501: 00000100:00100000:3.0:1789117356.104917:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f65e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385447424:0@lo:503: 00000100:00100000:3.0:1789117356.104961:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117356.105111:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a97640c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117356.105159:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385447424 00000100:00100000:2.0:1789117356.105165:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385447424 00000100:00100000:2.0:1789117356.105512:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789117356.105521:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:5837:x1876025385447424:12345-0@lo:503: 00000100:00100000:3.0:1789117356.106034:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f65e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385447424:0@lo:503: 00000100:00100000:2.0:1789117356.106185:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:5837:x1876025385447424:12345-0@lo:503: Request processed in 399us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117356.106194:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789117356.106949:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8467:1876025385447552:0@lo:502: 00000100:00100000:2.0:1789117356.106994:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117356.107028:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787c053c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117356.107255:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385447552 00000100:00100000:0.0:1789117356.107261:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385447552 00000100:00100000:0.0:1789117356.107299:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789117356.107307:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:8467:x1876025385447552:12345-0@lo:502: 00000100:00100000:0.0:1789117356.109940:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:8467:x1876025385447552:12345-0@lo:502: Request processed in 2628us (2939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117356.109954:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789117356.110036:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8467:1876025385447552:0@lo:502: 00000100:00100000:2.0:1789117356.110096:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8467:1876025385447680:0@lo:502: 00000100:00100000:2.0:1789117356.110142:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117356.110167:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787c053c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117356.112858:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385447680 00000100:00100000:0.0:1789117356.112870:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385447680 00000100:00100000:0.0:1789117356.112990:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789117356.113001:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:8467:x1876025385447680:12345-0@lo:502: 00000100:00100000:0.0:1789117356.113300:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:8467:x1876025385447680:12345-0@lo:502: Request processed in 301us (3158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117356.113310:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789117356.113339:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8467:1876025385447680:0@lo:502: 00000040:00080000:1.0:1789117356.113386:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789117356.113543:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789117356.113562:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789117356.113572:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457ea00/0xf7565228e460dc25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc2c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117356.113582:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178457ea00/0xf7565228e460dc25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc2c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117356.113593:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789117356.113657:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789117356.113661:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789117356.113688:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e200/0xf7565228e460dc33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117356.113696:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178457e200/0xf7565228e460dc33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117356.113705:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178457e200/0xf7565228e460dc33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117356.113728:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385447808:0@lo:101: 00000100:00100000:2.0:1789117356.113856:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117356.117341:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385447808 00000100:00100000:3.0:1789117356.117354:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385447808 00000100:00100000:2.0:1789117356.117364:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787c053c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117356.117424:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789117356.117435:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+13:5837:x1876025385447808:12345-0@lo:101: 00010000:00010000:3.0:1789117356.117450:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117356.117467:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178149da00/0xf7565228e460dc3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dc33 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117356.117492:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178149da00/0xf7565228e460dc3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dc33 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117356.117503:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178149da00/0xf7565228e460dc3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dc33 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117356.117512:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178149da00, rc 0) 00000100:00100000:3.0:1789117356.117571:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:5837:x1876025385447808:12345-0@lo:101: Request processed in 139us (3714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117356.117578:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789117356.117866:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385447808:0@lo:101: 00010000:00010000:2.0:1789117356.118044:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178457e200/0xf7565228e460dc33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc3a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117356.118055:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178457e200/0xf7565228e460dc33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dc3a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117356.118248:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385447936:0@lo:501: 00000100:00100000:2.0:1789117356.118281:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117356.118311:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787c053c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117356.118334:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385447936 00000100:00100000:1.0:1789117356.118339:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385447936 00000100:00100000:1.0:1789117356.118372:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789117356.118379:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:5837:x1876025385447936:12345-0@lo:501: 00000100:00100000:1.0:1789117356.118676:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:5837:x1876025385447936:12345-0@lo:501: Request processed in 296us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117356.118683:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789117356.118880:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385447936:0@lo:501: 00000100:00100000:2.0:1789117356.118909:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385448064:0@lo:503: 00000100:00100000:2.0:1789117356.119024:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117356.119044:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787c053c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117356.119110:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385448064 00000100:00100000:0.0:1789117356.119114:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385448064 00000100:00100000:0.0:1789117356.119145:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789117356.119152:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:5837:x1876025385448064:12345-0@lo:503: 00000100:00100000:0.0:1789117356.119305:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:5837:x1876025385448064:12345-0@lo:503: Request processed in 153us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117356.119311:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789117356.119594:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385448064:0@lo:503: 00000100:00100000:0.0:1789117356.123121:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17a7d78780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8469:1876025385448192:0@lo:502: 00000100:00100000:0.0:1789117356.123201:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117356.123306:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c1d96480 going to sleep for 11 seconds 00000100:00100000:3.0:1789117356.123673:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385448192 00000100:00100000:3.0:1789117356.123777:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385448192 00000100:00100000:3.0:1789117356.123826:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789117356.123835:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:8469:x1876025385448192:12345-0@lo:502: 00000100:00100000:3.0:1789117356.124200:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:8469:x1876025385448192:12345-0@lo:502: Request processed in 365us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117356.124208:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789117356.125368:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17a7d78780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8469:1876025385448192:0@lo:502: 00000020:01000000:0.0:1789117356.125421:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117356.125430:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117356.125432:0:8469:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789117356.125437:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789117356.125479:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17a7d78780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8469:1876025385448320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117356.125533:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117356.125575:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c1d96480 going to sleep for 11 seconds 00000100:00100000:2.0:1789117356.125636:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385448320 00000100:00100000:2.0:1789117356.125642:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385448320 00000100:00100000:2.0:1789117356.125683:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789117356.125692:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:8469:x1876025385448320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117356.125861:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:8469:x1876025385448320:12345-0@lo:502:llog_process_th.0 Request processed in 169us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117356.125877:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789117356.125985:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17a7d78780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8469:1876025385448320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789117356.126004:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117356.126008:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117356.126010:0:8469:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789117356.126013:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1789117356.126157:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789117356.126173:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789117356.126182:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e200/0xf7565228e460dc33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc3a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117356.126191:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178457e200/0xf7565228e460dc33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc3a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117356.126200:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789117356.126202:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c17c03a3800 from 39 10000000:01000000:2.0:1789117356.126205:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789117356.126226:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e000/0xf7565228e460dc41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117356.126233:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178457e000/0xf7565228e460dc41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117356.126241:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178457e000/0xf7565228e460dc41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117356.126254:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385448448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789117356.126281:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117356.126308:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787c05840 going to sleep for 11 seconds 00000100:00100000:0.0:1789117356.126353:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385448448 00000100:00100000:0.0:1789117356.126357:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385448448 00000100:00100000:0.0:1789117356.126389:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789117356.126396:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:5837:x1876025385448448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117356.126430:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117356.126443:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1780031a00/0xf7565228e460dc48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dc41 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117356.126466:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1780031a00/0xf7565228e460dc48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dc41 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117356.126477:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1780031a00/0xf7565228e460dc48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dc41 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117356.126492:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1780031a00, rc 0) 00000100:00100000:0.0:1789117356.126723:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:5837:x1876025385448448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 326us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117356.126729:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789117356.126864:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385448448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117356.126878:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178457e000/0xf7565228e460dc41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc48 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117356.126897:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178457e000/0xf7565228e460dc41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dc48 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117356.126942:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385448576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117356.126967:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117356.126995:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787c05840 going to sleep for 11 seconds 00000100:00100000:1.0:1789117356.127045:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385448576 00000100:00100000:1.0:1789117356.127050:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385448576 00000100:00100000:1.0:1789117356.127117:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789117356.127125:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:5837:x1876025385448576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117356.127332:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:5837:x1876025385448576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 207us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117356.127339:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789117356.127396:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385448576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117356.127451:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385448704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117356.127485:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117356.129218:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787c05840 going to sleep for 11 seconds 00000100:00100000:3.0:1789117356.129241:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385448704 00000100:00100000:3.0:1789117356.129248:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385448704 00000100:00100000:0.0:1789117356.129911:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789117356.129940:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:5837:x1876025385448704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117356.130159:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:5837:x1876025385448704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 222us (2672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117356.130167:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789117356.130278:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385448704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117356.131498:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f65e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8470:1876025385448832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117356.131556:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117356.131662:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385448832 00000100:00100000:0.0:1789117356.131667:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385448832 00000100:00100000:0.0:1789117356.131706:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789117356.131715:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:8470:x1876025385448832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117356.131744:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a9764180 going to sleep for 11 seconds 00000100:00100000:0.0:1789117356.132476:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:8470:x1876025385448832:12345-0@lo:502:llog_process_th.0 Request processed in 759us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117356.132484:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789117356.132558:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f65e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8470:1876025385448832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117356.132612:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f65e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8470:1876025385448960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117356.133268:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117356.133307:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178c4dcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117356.133660:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385448960 00000100:00100000:0.0:1789117356.133666:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385448960 00000100:00100000:0.0:1789117356.133809:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789117356.133817:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:8470:x1876025385448960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117356.134487:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:8470:x1876025385448960:12345-0@lo:502:llog_process_th.0 Request processed in 669us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117356.134495:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789117356.134556:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f65e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8470:1876025385448960:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789117356.134582:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789117356.134999:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789117356.135016:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789117356.135026:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e000/0xf7565228e460dc41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc48 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117356.135036:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178457e000/0xf7565228e460dc41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc48 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117356.135046:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789117356.135048:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1789117356.135051:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789117356.135076:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457ee00/0xf7565228e460dc4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117356.135216:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178457ee00/0xf7565228e460dc4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117356.135237:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178457ee00/0xf7565228e460dc4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117356.135255:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385449088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789117356.135288:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117356.135442:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385449088 00000100:00100000:1.0:1789117356.135448:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385449088 00000100:00100000:2.0:1789117356.135488:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787c05840 going to sleep for 11 seconds 00000100:00100000:1.0:1789117356.135652:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789117356.135661:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:5837:x1876025385449088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117356.135671:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117356.135684:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1781684200/0xf7565228e460dc56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dc4f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117356.135704:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1781684200/0xf7565228e460dc56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dc4f expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117356.135714:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1781684200/0xf7565228e460dc56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dc4f expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117356.135729:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781684200, rc 0) 00000100:00100000:1.0:1789117356.135771:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:5837:x1876025385449088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117356.135777:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789117356.135841:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385449088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117356.135853:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178457ee00/0xf7565228e460dc4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc56 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117356.135862:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178457ee00/0xf7565228e460dc4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dc56 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117356.135903:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385449216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117356.135929:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117356.136024:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787c05840 going to sleep for 11 seconds 00000100:00100000:3.0:1789117356.136096:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385449216 00000100:00100000:3.0:1789117356.136100:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385449216 00000100:00100000:3.0:1789117356.136120:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789117356.136126:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:5837:x1876025385449216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117356.136331:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:5837:x1876025385449216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117356.136339:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789117356.136430:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385449216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117356.136472:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385449344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117356.136505:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117356.136529:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787c05840 going to sleep for 11 seconds 00000100:00100000:3.0:1789117356.136636:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385449344 00000100:00100000:3.0:1789117356.136640:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385449344 00000100:00100000:3.0:1789117356.136660:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789117356.136666:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:5837:x1876025385449344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117356.136792:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:5837:x1876025385449344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117356.136799:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789117356.136878:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385449344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117356.137263:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8471:1876025385449472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117356.137354:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117356.137377:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787c05600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117356.137424:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385449472 00000100:00100000:3.0:1789117356.137428:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385449472 00000100:00100000:3.0:1789117356.137443:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789117356.137448:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:8471:x1876025385449472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117356.137739:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:8471:x1876025385449472:12345-0@lo:502:llog_process_th.0 Request processed in 289us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117356.137746:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789117356.138500:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8471:1876025385449472:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789117356.138527:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117356.138537:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117356.138539:0:8471:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789117356.138544:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789117356.138569:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8471:1876025385449600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117356.138607:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117356.138650:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681628540 going to sleep for 11 seconds 00000100:00100000:3.0:1789117356.139002:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385449600 00000100:00100000:3.0:1789117356.139007:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385449600 00000100:00100000:3.0:1789117356.139032:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789117356.139040:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:8471:x1876025385449600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117356.139199:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:8471:x1876025385449600:12345-0@lo:502:llog_process_th.0 Request processed in 159us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117356.139206:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789117356.139238:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8471:1876025385449600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789117356.139268:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117356.139274:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117356.139276:0:8471:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789117356.139280:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1789117356.139648:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1789117356.139663:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789117356.139672:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457ee00/0xf7565228e460dc4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc56 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117356.139791:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178457ee00/0xf7565228e460dc4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc56 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117356.139801:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789117356.139804:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c178548d000 from 39 10000000:01000000:3.0:1789117356.139807:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789117356.139832:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149ca00/0xf7565228e460dc5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117356.139840:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178149ca00/0xf7565228e460dc5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117356.139856:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178149ca00/0xf7565228e460dc5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117356.139873:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f65e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385449728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789117356.139903:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117356.140163:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b22b8780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117356.140196:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385449728 00000100:00100000:0.0:1789117356.140201:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385449728 00000100:00100000:0.0:1789117356.140332:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789117356.140341:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:5837:x1876025385449728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117356.140350:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117356.140362:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1780030800/0xf7565228e460dc64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dc5d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117356.140382:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1780030800/0xf7565228e460dc64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dc5d expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117356.140392:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1780030800/0xf7565228e460dc64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dc5d expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117356.140430:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1780030800, rc 0) 00000100:00100000:0.0:1789117356.140467:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385449728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117356.140473:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789117356.140548:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f65e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385449728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117356.140561:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178149ca00/0xf7565228e460dc5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc64 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117356.140570:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178149ca00/0xf7565228e460dc5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dc64 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117356.140615:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f65e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385449856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117356.140742:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117356.141036:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b22b8780 going to sleep for 11 seconds 00000100:00100000:1.0:1789117356.141178:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385449856 00000100:00100000:1.0:1789117356.141184:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385449856 00000100:00100000:1.0:1789117356.141211:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789117356.141218:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385449856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117356.141534:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385449856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 316us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117356.141541:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789117356.141615:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f65e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385449856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117356.141889:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f65e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385449984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117356.141928:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117356.141957:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b22b8780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117356.142184:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385449984 00000100:00100000:0.0:1789117356.142189:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385449984 00000100:00100000:0.0:1789117356.142258:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789117356.142266:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385449984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117356.142540:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385449984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 275us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117356.142557:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789117356.142765:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f65e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385449984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117356.143292:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8472:1876025385450112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117356.143334:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117356.143531:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17882576c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117356.143578:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385450112 00000100:00100000:0.0:1789117356.143583:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385450112 00000100:00100000:0.0:1789117356.143650:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789117356.143657:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:8472:x1876025385450112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117356.143903:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:8472:x1876025385450112:12345-0@lo:502:llog_process_th.0 Request processed in 245us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117356.143911:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789117356.144058:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8472:1876025385450112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117356.144114:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f65e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8472:1876025385450240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117356.144151:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117356.144315:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b22b8780 going to sleep for 11 seconds 00000100:00100000:1.0:1789117356.144342:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385450240 00000100:00100000:1.0:1789117356.144346:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385450240 00000100:00100000:1.0:1789117356.144366:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789117356.144373:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:8472:x1876025385450240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117356.144803:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:8472:x1876025385450240:12345-0@lo:502:llog_process_th.0 Request processed in 429us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117356.144810:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789117356.144924:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f65e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8472:1876025385450240:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789117356.145145:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789117356.145236:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789117356.145258:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789117356.145267:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149ca00/0xf7565228e460dc5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc64 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117356.145282:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178149ca00/0xf7565228e460dc5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc64 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117356.145292:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789117356.145294:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789117356.145297:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789117356.145321:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457fe00/0xf7565228e460dc6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117356.145329:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178457fe00/0xf7565228e460dc6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117356.145337:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178457fe00/0xf7565228e460dc6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117356.145352:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385450368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789117356.145381:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117356.145439:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681628600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117356.146186:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385450368 00000100:00100000:3.0:1789117356.146192:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385450368 00000100:00100000:3.0:1789117356.146267:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789117356.146277:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385450368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117356.146290:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117356.146305:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178149de00/0xf7565228e460dc72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dc6b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117356.146329:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178149de00/0xf7565228e460dc72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dc6b expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117356.146339:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178149de00/0xf7565228e460dc72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dc6b expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117356.146347:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178149de00, rc 0) 00000100:00100000:3.0:1789117356.146395:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385450368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117356.146418:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789117356.146491:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385450368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117356.146507:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178457fe00/0xf7565228e460dc6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc72 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117356.146526:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178457fe00/0xf7565228e460dc6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dc72 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117356.146576:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385450496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117356.146600:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117356.146868:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681628600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117356.146991:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385450496 00000100:00100000:1.0:1789117356.146996:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385450496 00000100:00100000:1.0:1789117356.147018:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789117356.147024:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385450496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117356.147247:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385450496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117356.147255:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789117356.147324:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385450496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117356.147352:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385450624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117356.147386:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117356.147420:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681628600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117356.147478:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385450624 00000100:00100000:1.0:1789117356.147482:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385450624 00000100:00100000:1.0:1789117356.147500:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789117356.147506:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385450624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117356.147661:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385450624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117356.147669:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789117356.147874:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385450624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117356.148425:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8473:1876025385450752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117356.148475:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117356.148496:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681628000 going to sleep for 11 seconds 00000100:00100000:1.0:1789117356.148644:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385450752 00000100:00100000:1.0:1789117356.148648:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385450752 00000100:00100000:1.0:1789117356.148669:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789117356.148676:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:8473:x1876025385450752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117356.148856:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:8473:x1876025385450752:12345-0@lo:502:llog_process_th.0 Request processed in 179us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117356.148863:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789117356.149289:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8473:1876025385450752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789117356.149311:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117356.149319:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117356.149321:0:8473:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789117356.149326:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789117356.149343:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8473:1876025385450880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117356.149377:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117356.149445:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681628000 going to sleep for 11 seconds 00000100:00100000:1.0:1789117356.149758:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385450880 00000100:00100000:1.0:1789117356.149764:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385450880 00000100:00100000:1.0:1789117356.149786:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789117356.149793:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:8473:x1876025385450880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117356.151593:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:8473:x1876025385450880:12345-0@lo:502:llog_process_th.0 Request processed in 1793us (2208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117356.151604:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789117356.152640:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8473:1876025385450880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789117356.152678:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117356.152686:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117356.152688:0:8473:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789117356.152692:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789117356.152831:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1789117356.152848:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789117356.152867:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457fe00/0xf7565228e460dc6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc72 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117356.152877:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178457fe00/0xf7565228e460dc6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc72 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117356.152886:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789117356.152888:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c17882d4ed8 from 1 10000000:01000000:1.0:1789117356.152891:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789117356.152920:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1781685000/0xf7565228e460dc79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117356.152928:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c1781685000/0xf7565228e460dc79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117356.152937:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c1781685000/0xf7565228e460dc79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117356.152955:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385451008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789117356.152997:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117356.153034:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17980a4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117356.153096:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385451008 00000100:00100000:0.0:1789117356.153102:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385451008 00000100:00100000:0.0:1789117356.153180:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789117356.153189:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385451008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117356.153199:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117356.153211:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1780031200/0xf7565228e460dc80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dc79 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117356.153231:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1780031200/0xf7565228e460dc80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dc79 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117356.153241:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1780031200/0xf7565228e460dc80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dc79 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117356.153250:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1780031200, rc 0) 00000100:00100000:0.0:1789117356.153292:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385451008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117356.153298:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789117356.153485:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385451008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117356.153499:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c1781685000/0xf7565228e460dc79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc80 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117356.153507:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c1781685000/0xf7565228e460dc79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dc80 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117356.153656:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385451136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117356.153813:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117356.153916:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17980a4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117356.154062:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385451136 00000100:00100000:0.0:1789117356.154073:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385451136 00000100:00100000:0.0:1789117356.154320:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789117356.154329:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385451136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117356.154564:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385451136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (750us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789117356.154571:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789117356.154648:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385451136:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789117356.154672:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789117356.154679:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1781685000/0xf7565228e460dc79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc80 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117356.154873:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c1781685000/0xf7565228e460dc79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc80 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117356.187565:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117356.187752:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362354944 00000100:00100000:0.0:1789117356.187761:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362354944 00000100:00100000:0.0:1789117356.187810:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 164 00000100:00100000:0.0:1789117356.187820:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+8:5605:x1876025362354944:12345-192.168.206.37@tcp:101: 00010000:00010000:0.0:1789117356.187835:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117356.187852:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1780031400/0xf7565228e460dc87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c6bf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117356.187878:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1780031400/0xf7565228e460dc87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6bf expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117356.187889:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1780031400/0xf7565228e460dc87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6bf expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117356.187898:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1780031400, rc 0) 00000100:00100000:0.0:1789117356.187960:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+9:5605:x1876025362354944:12345-192.168.206.37@tcp:101: Request processed in 141us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117356.187967:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 164 00000100:00100000:0.0:1789117356.193443:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117356.194232:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362355072 00000100:00100000:1.0:1789117356.194247:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362355072 00000100:00100000:1.0:1789117356.194305:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 165 00000100:00100000:1.0:1789117356.194314:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+9:5605:x1876025362355072:12345-192.168.206.37@tcp:501: 00000100:00100000:1.0:1789117356.194891:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+9:5605:x1876025362355072:12345-192.168.206.37@tcp:501: Request processed in 567us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117356.194899:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 165 00000100:00100000:2.0:1789117356.196933:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117356.197860:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362355200 00000100:00100000:3.0:1789117356.197869:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362355200 00000100:00100000:3.0:1789117356.197978:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 166 00000100:00100000:3.0:1789117356.197988:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+9:5605:x1876025362355200:12345-192.168.206.37@tcp:503: 00000100:00100000:3.0:1789117356.198209:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+9:5605:x1876025362355200:12345-192.168.206.37@tcp:503: Request processed in 221us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117356.198224:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 166 00000100:00100000:2.0:1789117356.202469:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117356.202611:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362355328 00000100:00100000:1.0:1789117356.202621:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362355328 00000100:00100000:1.0:1789117356.202675:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 167 00000100:00100000:1.0:1789117356.202684:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+9:6078:x1876025362355328:12345-192.168.206.37@tcp:502: 00000100:00100000:1.0:1789117356.202949:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+9:6078:x1876025362355328:12345-192.168.206.37@tcp:502: Request processed in 265us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117356.202957:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 167 00000100:00100000:1.0:1789117356.205643:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117356.205722:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362355456 00000100:00100000:3.0:1789117356.205729:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362355456 00000100:00100000:3.0:1789117356.205774:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 168 00000100:00100000:3.0:1789117356.205783:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+9:6078:x1876025362355456:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789117356.206042:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+9:6078:x1876025362355456:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 257us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117356.206050:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 168 00000100:00100000:2.0:1789117356.209433:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117356.210087:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362355584 00000100:00100000:0.0:1789117356.210097:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362355584 00000100:00100000:0.0:1789117356.210149:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 169 00000100:00100000:0.0:1789117356.210171:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+9:5605:x1876025362355584:12345-192.168.206.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117356.210186:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117356.210214:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1787cbd200/0xf7565228e460dc8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c6c6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117356.210241:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1787cbd200/0xf7565228e460dc8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6c6 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117356.210252:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1787cbd200/0xf7565228e460dc8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6c6 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117356.210262:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbd200, rc 0) 00000100:00100000:0.0:1789117356.210326:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:5605:x1876025362355584:12345-192.168.206.37@tcp:101:ll_cfg_requeue.0 Request processed in 157us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117356.210334:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 169 00000100:00100000:2.0:1789117356.212811:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117356.212898:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362355712 00000100:00100000:1.0:1789117356.212916:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362355712 00000100:00100000:1.0:1789117356.212974:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 170 00000100:00100000:1.0:1789117356.212984:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:5605:x1876025362355712:12345-192.168.206.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117356.213310:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:5605:x1876025362355712:12345-192.168.206.37@tcp:501:ll_cfg_requeue.0 Request processed in 326us (504us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789117356.213916:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 170 00010000:00010000:2.0:1789117356.869842:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117357.735581:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117357.735624:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117357.735652:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117357.735673:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117357.735697:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362356096 00000100:00100000:1.0:1789117357.735705:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362356096 00000100:00100000:1.0:1789117357.735750:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362356224 00000100:00100000:1.0:1789117357.735752:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362356224 00000100:00100000:1.0:1789117357.735771:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 14 00000100:00100000:1.0:1789117357.735779:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+5:2349:x1876025362356096:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117357.735835:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+5:2349:x1876025362356096:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 57us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117357.735842:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 14 00000100:00100000:1.0:1789117357.735855:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 15 00000100:00100000:1.0:1789117357.735860:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+5:2349:x1876025362356224:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117357.735878:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+5:2349:x1876025362356224:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 18us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117357.735883:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 15 00000100:00100000:3.0:1789117357.738383:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362355840 00000100:00100000:3.0:1789117357.738396:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362355840 00000100:00100000:3.0:1789117357.738491:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 171 00000100:00100000:3.0:1789117357.738501:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2349:x1876025362355840:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117357.738571:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2349:x1876025362355840:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 70us (3000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117357.738579:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 171 00000100:00100000:2.0:1789117357.739338:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362355968 00000100:00100000:2.0:1789117357.739344:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362355968 00000100:00100000:2.0:1789117357.739392:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 28 00000100:00100000:2.0:1789117357.739427:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2349:x1876025362355968:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117357.739466:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2349:x1876025362355968:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 67us (3812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117357.739472:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 28 00000100:00080000:2.0:1789117357.739490:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789117357.739494:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789117357.739497:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1789117357.787972:0:8512:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd52f2ad50 20000000:00000080:1.0:1789117357.787986:0:8512:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c17c01f4000 uarg=0000000000000000 20000000:01000000:1.0:1789117357.788292:0:8512:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789117357.788371:0:8512:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789117357.788377:0:8512:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789117357.789739:0:8513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1789117357.789889:0:8512:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1789117357.797200:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1789117357.797253:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1789117357.797393:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1789117357.797679:0:8512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789117357.797697:0:8512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c178457f800/0xf7565228e460dc95 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117357.797723:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1780030a00/0xf7565228e460da0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460da03 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117357.797731:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178149d000/0xf7565228e460da6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460da65 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117357.797738:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178457f600/0xf7565228e460db37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460db30 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117357.797747:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1780030600/0xf7565228e460dbf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c68e expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117357.797754:0:8512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c178457f800/0xf7565228e460dc95 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117357.797793:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1780030600/0xf7565228e460dbf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c68e expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117357.797808:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1780030600/0xf7565228e460dbf4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c68e expref: 9 pid: 5833 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117357.797821:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876025385451264:192.168.206.37@tcp:104: 00010000:00010000:2.0:1789117357.797969:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178457f600/0xf7565228e460db37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460db30 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117357.797978:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c178457f600/0xf7565228e460db37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460db30 expref: 18 pid: 5834 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117357.797988:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876025385451392:0@lo:104: 00000100:00100000:2.0:1789117357.798033:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789117357.798074:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178149d000/0xf7565228e460da6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460da65 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117357.798082:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c178149d000/0xf7565228e460da6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460da65 expref: 18 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117357.798091:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b0780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876025385451520:0@lo:104: 00000100:00100000:2.0:1789117357.798114:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789117357.798147:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1780030a00/0xf7565228e460da0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460da03 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117357.798155:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1780030a00/0xf7565228e460da0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460da03 expref: 18 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117357.798162:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b1e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876025385451648:0@lo:104: 00000100:00100000:2.0:1789117357.798179:0:8512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17883aed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789117357.798260:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789117357.798279:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117357.798293:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385451392 00000100:00100000:3.0:1789117357.798311:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385451392 00000100:00100000:3.0:1789117357.798343:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385451520 00000100:00100000:3.0:1789117357.798346:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385451520 00000100:00100000:3.0:1789117357.798356:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385451648 00000100:00100000:3.0:1789117357.798358:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385451648 00000100:00100000:3.0:1789117357.798371:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789117357.798379:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+5:8512:x1876025385451392:12345-0@lo:104: 00010000:00010000:3.0:1789117357.798432:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c178149c200/0xf7565228e460db30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460db37 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.798491:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789117357.798497:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+5:8512:x1876025385451392:12345-0@lo:104: Request processed in 119us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117357.798505:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789117357.798522:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789117357.798528:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681585850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+4:8512:x1876025385451520:12345-0@lo:104: 00010000:00010000:3.0:1789117357.798550:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460da65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460da6c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.798590:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789117357.798595:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681585850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+4:8512:x1876025385451520:12345-0@lo:104: Request processed in 68us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117357.798600:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789117357.798642:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789117357.798648:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f65e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:8512:x1876025385451648:12345-0@lo:104: 00010000:00010000:3.0:1789117357.798656:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460da03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460da0a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.798683:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789117357.798687:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f65e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:8512:x1876025385451648:12345-0@lo:104: Request processed in 41us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117357.798692:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1789117357.798708:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789117357.798714:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c178149c200/0xf7565228e460db30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460db37 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.798726:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178149c200 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:3.0:1789117357.798730:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c178149c200/0xf7565228e460db30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460db37 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.798738:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178149c200/0xf7565228e460db30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460db37 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117357.798745:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178149c200/0xf7565228e460db30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460db37 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117357.798749:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789117357.798774:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c178149c200/0xf7565228e460db30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460db37 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.798781:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117357.798801:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c178149c200/0xf7565228e460db30 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460db37 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.798808:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178149c200/0xf7565228e460db30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460db37 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.798821:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789117357.798824:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460da65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460da6c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.798830:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2045e00 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:3.0:1789117357.798833:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460da65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460da6c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.798849:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460da65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460da6c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117357.798856:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460da65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460da6c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117357.798861:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789117357.798875:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460da65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460da6c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.798881:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117357.798896:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460da65 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460da6c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.798902:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460da65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460da6c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.798912:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117357.798915:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460da03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460da0a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.798920:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781684000 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:3.0:1789117357.798923:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460da03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460da0a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.798930:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460da03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460da0a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789117357.798936:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460da03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460da0a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117357.798947:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789117357.798959:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460da03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460da0a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.798964:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117357.798970:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460da03 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460da0a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.798977:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460da03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460da0a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.798990:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117357.798991:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117357.798993:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117357.799012:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385451776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789117357.799041:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117357.799081:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385451904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789117357.799102:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117357.799119:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117357.799123:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385452032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789117357.799143:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117357.799168:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385451776 00000100:00100000:3.0:1789117357.799172:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385451776 00010000:00010000:3.0:1789117357.799189:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178457f600/0xf7565228e460db37 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460db30 expref: 19 pid: 5834 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117357.799207:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385451904 00000100:00100000:3.0:1789117357.799209:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385451904 00010000:00010000:3.0:1789117357.799229:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178149d000/0xf7565228e460da6c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460da65 expref: 20 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117357.799241:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385452032 00000100:00100000:3.0:1789117357.799243:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385452032 00010000:00010000:3.0:1789117357.799252:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1780030a00/0xf7565228e460da0a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460da03 expref: 21 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117357.799262:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789117357.799267:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f65680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+21:3301:x1876025385451776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789117357.799275:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117357.799280:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178457f600/0xf7565228e460db37 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460db30 expref: 21 pid: 5834 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.799288:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178457f600/0xf7565228e460db37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460db30 expref: 21 pid: 5834 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.799302:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117357.799327:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f65680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+21:3301:x1876025385451776:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117357.799333:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789117357.799344:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789117357.799350:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f643c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+20:3298:x1876025385451904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789117357.799356:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117357.799360:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178149d000/0xf7565228e460da6c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460da65 expref: 20 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.799367:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178149d000/0xf7565228e460da6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460da65 expref: 20 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.799386:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117357.799444:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f643c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+20:3298:x1876025385451904:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117357.799451:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789117357.799462:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789117357.799468:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f64b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3298:x1876025385452032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789117357.799475:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117357.799479:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1780030a00/0xf7565228e460da0a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460da03 expref: 19 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.799486:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1780030a00/0xf7565228e460da0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460da03 expref: 19 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.799495:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117357.799514:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f64b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3298:x1876025385452032:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117357.799520:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789117357.799555:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385451776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789117357.799593:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385452032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789117357.799600:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385451904:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789117357.799850:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178457f600/0xf7565228e460db37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460db30 expref: 18 pid: 5834 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117357.799860:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876025385451392:0@lo:104: 00010000:00010000:2.0:1789117357.799870:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178149d000/0xf7565228e460da6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460da65 expref: 17 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117357.799878:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b0780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876025385451520:0@lo:104: 00010000:00010000:2.0:1789117357.799885:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1780030a00/0xf7565228e460da0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460da03 expref: 16 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117357.799893:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b1e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876025385451648:0@lo:104: 00010000:00010000:1.0:1789117357.800272:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117357.806468:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876025385451264:192.168.206.37@tcp:104: 00010000:00010000:2.0:1789117357.806504:0:8512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c178457f800/0xf7565228e460dc95 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117357.807368:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117357.807465:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362356352 00000100:00100000:0.0:1789117357.807476:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362356352 00010000:00010000:0.0:1789117357.807510:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1780030600/0xf7565228e460dbf4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c68e expref: 10 pid: 5833 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117357.807550:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 24 00000100:00100000:0.0:1789117357.807560:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f67840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2350:x1876025362356352:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117357.807574:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117357.807579:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1780030600/0xf7565228e460dbf4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c68e expref: 10 pid: 5833 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117357.807591:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1780030600/0xf7565228e460dbf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c68e expref: 10 pid: 5833 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117357.807634:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1780030600/0xf7565228e460dbf4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c68e expref: 10 pid: 5833 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117357.807652:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c178457f800/0xf7565228e460dc95 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117357.807666:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178457f800/0xf7565228e460dc95 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117357.807681:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178457f800/0xf7565228e460dc95 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117357.807687:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178457f800/0xf7565228e460dc95 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117357.807693:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c178457f800/0xf7565228e460dc95 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117357.807699:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c178457f800/0xf7565228e460dc95 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117357.807705:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f800 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:0.0:1789117357.807709:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c178457f800/0xf7565228e460dc95 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117357.807716:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c178457f800/0xf7565228e460dc95 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117357.807737:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c178457f800/0xf7565228e460dc95 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117357.807757:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117357.807805:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f67840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+9:2350:x1876025362356352:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 246us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117357.807813:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 24 00010000:00010000:2.0:1789117357.808329:0:8512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c178457f800/0xf7565228e460dc95 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117357.808339:0:8512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c178457f800/0xf7565228e460dc95 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117357.808345:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178457f800/0xf7565228e460dc95 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117357.906945:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117357.913144:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117357.913223:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362356480 00000100:00100000:2.0:1789117357.913232:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362356480 00000100:00100000:2.0:1789117357.913284:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 172 00000100:00100000:2.0:1789117357.913292:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+9:5605:x1876025362356480:12345-192.168.206.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117357.913308:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117357.913326:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178457f800/0xf7565228e460dc9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c6cd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117357.913352:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178457f800/0xf7565228e460dc9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6cd expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117357.913363:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178457f800/0xf7565228e460dc9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6cd expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117357.913372:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f800, rc 0) 00000100:00100000:2.0:1789117357.913447:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:5605:x1876025362356480:12345-192.168.206.37@tcp:101:ll_cfg_requeue.0 Request processed in 155us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117357.913464:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 172 00000100:00100000:2.0:1789117357.918797:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117357.919703:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362356608 00000100:00100000:0.0:1789117357.919714:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362356608 00000100:00100000:0.0:1789117357.919779:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 173 00000100:00100000:0.0:1789117357.919789:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:5605:x1876025362356608:12345-192.168.206.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117357.920078:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:5605:x1876025362356608:12345-192.168.206.37@tcp:501:ll_cfg_requeue.0 Request processed in 289us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117357.920087:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 173 00000100:00100000:0.0:1789117357.938195:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117357.938287:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362356736 00000100:00100000:1.0:1789117357.938295:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362356736 00000100:00100000:1.0:1789117357.938345:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 174 00000100:00100000:1.0:1789117357.938354:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:5605:x1876025362356736:12345-192.168.206.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117357.938602:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:5605:x1876025362356736:12345-192.168.206.37@tcp:503:ll_cfg_requeue.0 Request processed in 247us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117357.938610:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 174 00000100:00100000:1.0:1789117357.944245:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117357.944289:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362356864 00000100:00100000:1.0:1789117357.944298:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362356864 00000100:00100000:1.0:1789117357.944342:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 175 00000100:00100000:1.0:1789117357.944351:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:6104:x1876025362356864:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789117357.948785:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:6104:x1876025362356864:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 4410us (4524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117357.948799:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 175 00000100:00100000:1.0:1789117357.970155:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117357.970224:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362356992 00000100:00100000:0.0:1789117357.970233:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362356992 00000100:00100000:0.0:1789117357.970284:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 176 00000100:00100000:0.0:1789117357.970293:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:6104:x1876025362356992:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789117357.970544:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:6104:x1876025362356992:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 251us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117357.970552:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 176 00010000:00010000:1.0:1789117358.917622:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789117359.440104:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789117359.440111:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c16816f2800 from 4 10000000:01000000:0.0:1789117359.440116:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789117359.440159:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1787cbda00/0xf7565228e460dca3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117359.440187:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c1787cbda00/0xf7565228e460dca3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117359.440197:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c1787cbda00/0xf7565228e460dca3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117359.440220:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17a7d783c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385452160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789117359.440294:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117359.440346:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178720e480 going to sleep for 11 seconds 00000100:00100000:2.0:1789117359.440764:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385452160 00000100:00100000:2.0:1789117359.440772:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385452160 00000100:00100000:2.0:1789117359.440831:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789117359.440840:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:5837:x1876025385452160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117359.440854:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117359.440867:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178457ec00/0xf7565228e460dcaa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dca3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117359.440888:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178457ec00/0xf7565228e460dcaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dca3 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117359.440897:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178457ec00/0xf7565228e460dcaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dca3 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117359.440904:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457ec00, rc 0) 00000100:00100000:2.0:1789117359.440945:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385452160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117359.440951:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789117359.440994:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17a7d783c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385452160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117359.441007:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c1787cbda00/0xf7565228e460dca3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dcaa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117359.441015:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c1787cbda00/0xf7565228e460dca3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dcaa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117359.441081:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385452288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117359.441108:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117359.441121:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17883aef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117359.441310:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385452288 00000100:00100000:1.0:1789117359.441315:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385452288 00000100:00100000:1.0:1789117359.441338:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789117359.441345:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385452288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117359.441585:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385452288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117359.441600:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789117359.441724:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385452288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117359.441755:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385452416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117359.441799:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117359.441814:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785c04600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117359.441825:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385452416 00000100:00100000:1.0:1789117359.441829:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385452416 00000100:00100000:1.0:1789117359.441844:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789117359.441849:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385452416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117359.441977:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385452416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117359.441983:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789117359.442018:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385452416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117359.442174:0:8565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8565:1876025385452544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117359.442205:0:8565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117359.442223:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385452544 00000100:00100000:1.0:1789117359.442226:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385452544 00000100:00100000:1.0:1789117359.442243:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789117359.442248:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:8565:x1876025385452544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117359.442367:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:8565:x1876025385452544:12345-0@lo:502:llog_process_th.0 Request processed in 117us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117359.442372:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789117359.442416:0:8565:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785c04480 going to sleep for 11 seconds 00000100:00100000:1.0:1789117359.442429:0:8565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8565:1876025385452544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117359.442455:0:8565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117359.442463:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117359.442465:0:8565:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789117359.442471:0:8565:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c16816f2800 00000020:00000080:1.0:1789117359.442473:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789117359.442543:0:8565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8565:1876025385452672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117359.442574:0:8565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117359.442592:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385452672 00000100:00100000:1.0:1789117359.442596:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385452672 00000100:00100000:1.0:1789117359.442624:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789117359.442630:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:8565:x1876025385452672:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117359.442724:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:8565:x1876025385452672:12345-0@lo:502:llog_process_th.0 Request processed in 94us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117359.442730:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789117359.442757:0:8565:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785c04480 going to sleep for 11 seconds 00000100:00100000:1.0:1789117359.442768:0:8565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8565:1876025385452672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117359.442786:0:8565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117359.442790:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117359.442792:0:8565:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789117359.442795:0:8565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789117359.442836:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789117359.442852:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789117359.442858:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1787cbda00/0xf7565228e460dca3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dcaa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117359.442867:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c1787cbda00/0xf7565228e460dca3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dcaa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117359.442885:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789117359.442888:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c17c03a3800 from 4 10000000:01000000:1.0:1789117359.442890:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789117359.442909:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460dcb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117359.442916:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460dcb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117359.442925:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460dcb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117359.442936:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385452800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789117359.442958:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117359.442971:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785c04480 going to sleep for 11 seconds 00000100:00100000:1.0:1789117359.442981:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385452800 00000100:00100000:1.0:1789117359.442985:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385452800 00000100:00100000:1.0:1789117359.443001:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789117359.443007:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385452800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117359.443014:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117359.443024:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1781685200/0xf7565228e460dcb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dcb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117359.443041:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1781685200/0xf7565228e460dcb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dcb1 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117359.443050:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1781685200/0xf7565228e460dcb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dcb1 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117359.443069:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685200, rc 0) 00000100:00100000:1.0:1789117359.443097:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385452800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117359.443103:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789117359.443133:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385452800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117359.443143:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460dcb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dcb8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117359.443151:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460dcb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dcb8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117359.443188:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385452928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117359.443212:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117359.443224:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785c04480 going to sleep for 11 seconds 00000100:00100000:1.0:1789117359.443234:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385452928 00000100:00100000:1.0:1789117359.443237:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385452928 00000100:00100000:1.0:1789117359.443252:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789117359.443258:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385452928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117359.443443:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385452928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117359.443449:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789117359.443483:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385452928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117359.443506:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385453056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117359.443536:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117359.443554:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785c04480 going to sleep for 11 seconds 00000100:00100000:1.0:1789117359.443565:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385453056 00000100:00100000:1.0:1789117359.443568:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385453056 00000100:00100000:1.0:1789117359.443583:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789117359.443589:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385453056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117359.443706:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385453056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117359.443712:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789117359.443746:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385453056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117359.448168:0:8566:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8566:1876025385453184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117359.448247:0:8566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117359.448285:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385453184 00000100:00100000:2.0:1789117359.448290:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385453184 00000100:00100000:2.0:1789117359.448328:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789117359.448336:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:8566:x1876025385453184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117359.448541:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:8566:x1876025385453184:12345-0@lo:502:llog_process_th.0 Request processed in 205us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117359.448549:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789117359.448596:0:8566:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c07699c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117359.448626:0:8566:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8566:1876025385453184:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789117359.448663:0:8566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117359.448672:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117359.448674:0:8566:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789117359.448679:0:8566:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c17c03a3800 00000020:00000080:2.0:1789117359.448682:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789117359.449249:0:8566:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8566:1876025385453312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117359.449292:0:8566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117359.449315:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385453312 00000100:00100000:2.0:1789117359.449319:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385453312 00000100:00100000:2.0:1789117359.449344:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789117359.449351:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:8566:x1876025385453312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117359.449499:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:8566:x1876025385453312:12345-0@lo:502:llog_process_th.0 Request processed in 147us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117359.449506:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789117359.449535:0:8566:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c07699c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117359.449548:0:8566:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8566:1876025385453312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789117359.449568:0:8566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117359.449573:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117359.449575:0:8566:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789117359.449578:0:8566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789117359.449636:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789117359.449653:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789117359.449661:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460dcb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dcb8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117359.449671:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460dcb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dcb8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117359.449681:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789117359.449683:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c178548d000 from 4 10000000:01000000:2.0:1789117359.449686:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789117359.449707:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460dcbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117359.449715:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460dcbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117359.449723:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460dcbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117359.449735:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385453440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789117359.449768:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117359.449781:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c07699c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117359.449793:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385453440 00000100:00100000:2.0:1789117359.449796:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385453440 00000100:00100000:2.0:1789117359.449816:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789117359.449823:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385453440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117359.449830:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117359.449841:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178457e800/0xf7565228e460dcc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dcbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117359.449859:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178457e800/0xf7565228e460dcc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dcbf expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117359.449868:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178457e800/0xf7565228e460dcc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dcbf expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117359.449876:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457e800, rc 0) 00000100:00100000:2.0:1789117359.449903:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385453440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117359.449910:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789117359.449939:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385453440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117359.449949:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460dcbf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dcc6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117359.449959:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460dcbf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dcc6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117359.449996:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385453568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117359.450026:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117359.450039:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c07699c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117359.450050:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385453568 00000100:00100000:2.0:1789117359.450053:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385453568 00000100:00100000:2.0:1789117359.450074:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789117359.450079:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385453568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117359.450266:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385453568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117359.450273:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789117359.450302:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385453568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117359.450326:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385453696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117359.450358:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117359.450371:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c07699c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117359.450382:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385453696 00000100:00100000:2.0:1789117359.450385:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385453696 00000100:00100000:2.0:1789117359.450426:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789117359.450433:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385453696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117359.450542:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385453696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117359.450549:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789117359.450584:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385453696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117359.456888:0:8568:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8568:1876025385453824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117359.456962:0:8568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117359.457006:0:8568:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178871a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117359.457498:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385453824 00000100:00100000:2.0:1789117359.457505:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385453824 00000100:00100000:2.0:1789117359.457548:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789117359.457556:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:8568:x1876025385453824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117359.458915:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:8568:x1876025385453824:12345-0@lo:502:llog_process_th.0 Request processed in 1354us (1948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117359.458925:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789117359.459062:0:8568:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8568:1876025385453824:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117359.459094:0:8568:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117359.459103:0:8568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117359.459105:0:8568:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789117359.459111:0:8568:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c178548d000 00000020:00000080:1.0:1789117359.459114:0:8568:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789117359.459194:0:8568:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8568:1876025385453952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117359.459238:0:8568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117359.459270:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385453952 00000100:00100000:1.0:1789117359.459275:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385453952 00000100:00100000:1.0:1789117359.459305:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789117359.459313:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:8568:x1876025385453952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117359.459492:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:8568:x1876025385453952:12345-0@lo:502:llog_process_th.0 Request processed in 179us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117359.459509:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789117359.459545:0:8568:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785c04480 going to sleep for 11 seconds 00000100:00100000:1.0:1789117359.459558:0:8568:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:8568:1876025385453952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117359.459577:0:8568:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117359.459582:0:8568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117359.459584:0:8568:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789117359.459588:0:8568:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789117359.465693:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789117359.465725:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117359.465735:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460dcbf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dcc6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117359.465755:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460dcbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dcc6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117359.691155:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385454080:0@lo:400:kworker.0 00000100:00100000:1.0:1789117359.691222:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117359.691268:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788842580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385454592:0@lo:400:kworker.0 00000100:00100000:1.0:1789117359.691292:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117359.691319:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117359.691325:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385454208:0@lo:400:kworker.0 00000100:00100000:1.0:1789117359.691346:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117359.691374:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788843840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385454336:0@lo:400:kworker.0 00000100:00100000:1.0:1789117359.691396:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117359.691427:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117359.691433:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788841680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385454464:0@lo:400:kworker.0 00000100:00100000:1.0:1789117359.691455:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117359.691481:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385454080 00000100:00100000:1.0:1789117359.691487:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385454080 00000100:00100000:1.0:1789117359.691526:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385454208 00000100:00100000:1.0:1789117359.691529:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385454208 00000100:00100000:1.0:1789117359.691549:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385454464 00000100:00100000:1.0:1789117359.691552:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385454464 00000100:00100000:1.0:1789117359.691566:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789117359.691572:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17888412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385454080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117359.691643:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17888412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385454080:12345-0@lo:400:kworker.0 Request processed in 70us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117359.691651:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789117359.691678:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789117359.691685:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385454208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117359.691711:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385454208:12345-0@lo:400:kworker.0 Request processed in 27us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117359.691717:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789117359.691728:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789117359.691733:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178bec8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385454464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117359.691759:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178bec8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385454464:12345-0@lo:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117359.691764:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789117359.691780:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385454592 00000100:00100000:1.0:1789117359.691783:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385454592 00000100:00100000:1.0:1789117359.691804:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385454336 00000100:00100000:1.0:1789117359.691807:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385454336 00000100:00100000:1.0:1789117359.691825:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789117359.691831:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385454592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117359.691858:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385454592:12345-0@lo:400:kworker.0 Request processed in 28us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117359.691864:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789117359.691874:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789117359.691880:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385454336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117359.691903:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385454336:12345-0@lo:400:kworker.0 Request processed in 24us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117359.691930:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1789117359.691956:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789117359.691960:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117359.691962:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117359.691988:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385454208:0@lo:400:kworker.0 00000100:00100000:1.0:1789117359.691999:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385454080:0@lo:400:kworker.0 00010000:00080000:1.0:1789117359.692010:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1788842580 x1876025385454592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117359.692020:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788842580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385454592:0@lo:400:kworker.0 00000100:00100000:1.0:1789117359.692055:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788841680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385454464:0@lo:400:kworker.0 00010000:00080000:1.0:1789117359.692064:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1788843840 x1876025385454336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117359.692073:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788843840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385454336:0@lo:400:kworker.0 00010000:00010000:3.0:1789117359.942612:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117360.198585:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385454720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117360.198677:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117360.198832:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385454720 00000100:00100000:2.0:1789117360.198839:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385454720 00000100:00100000:2.0:1789117360.198887:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789117360.198894:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385454720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789117360.198932:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789117360.198970:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385454720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117360.198977:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789117360.199332:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117360.199341:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178bec8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385454848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117360.199369:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117360.199391:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385454848 00000100:00100000:1.0:1789117360.199394:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385454848 00000100:00100000:1.0:1789117360.199439:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789117360.199445:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178becbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385454848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117360.199463:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117360.199489:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178becbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385454848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117360.199495:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789117360.199543:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c178bec8780 x1876025385454848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117360.199560:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178bec8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385454848:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789117360.199773:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b86b2d00 x1876025385454720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117360.199785:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385454720:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789117360.965693:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117361.993995:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117362.849691:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117362.849724:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117362.849749:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117362.849773:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117362.849800:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362357376 00000100:00100000:0.0:1789117362.849808:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362357376 00000100:00100000:0.0:1789117362.849857:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362357504 00000100:00100000:0.0:1789117362.849860:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362357504 00000100:00100000:0.0:1789117362.849883:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 18 00000100:00100000:0.0:1789117362.849892:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+5:2351:x1876025362357376:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117362.849956:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+5:2351:x1876025362357376:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 64us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117362.849963:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 18 00000100:00100000:0.0:1789117362.849982:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 19 00000100:00100000:0.0:1789117362.849988:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+5:2351:x1876025362357504:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117362.850011:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+5:2351:x1876025362357504:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 23us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117362.850026:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 19 00000100:00100000:0.0:1789117362.850045:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362357248 00000100:00100000:0.0:1789117362.850048:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362357248 00000100:00100000:0.0:1789117362.850076:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 32 00000100:00100000:0.0:1789117362.850083:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362357248:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117362.850110:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362357248:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 28us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117362.850116:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 32 00000100:00080000:0.0:1789117362.850134:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789117362.850138:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117362.850140:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117362.853808:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362357120 00000100:00100000:1.0:1789117362.853821:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362357120 00000100:00100000:1.0:1789117362.853882:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 192 00000100:00100000:1.0:1789117362.853891:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2351:x1876025362357120:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117362.853971:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2351:x1876025362357120:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 80us (4286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117362.853979:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 192 00010000:00010000:1.0:1789117363.013738:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117364.044456:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789117364.377504:0:8811:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg637-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1789117364.805615:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385454976:0@lo:400:kworker.0 00000100:00100000:3.0:1789117364.805664:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876025385455232:0@lo:400:kworker.0 00000100:00100000:1.0:1789117364.805693:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117364.805711:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117364.805749:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789117364.805752:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876025385455488:0@lo:400:kworker.0 00000100:00100000:3.0:1789117364.805759:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385455104:0@lo:400:kworker.0 00000100:00100000:3.0:1789117364.805788:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117364.805819:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385455232 00000100:00100000:3.0:1789117364.805821:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385455616:0@lo:400:kworker.0 00000100:00100000:1.0:1789117364.805827:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385455232 00000100:00100000:3.0:1789117364.805852:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117364.805883:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385455104 00000100:00100000:1.0:1789117364.805887:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385455104 00000100:00100000:3.0:1789117364.805888:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385455616 00000100:00100000:1.0:1789117364.805911:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789117364.805920:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876025385455232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117364.805982:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876025385455232:12345-0@lo:400:kworker.0 Request processed in 63us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117364.805989:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789117364.806007:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789117364.806013:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385455104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117364.806058:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385455616 00000100:00100000:1.0:1789117364.806066:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385455104:12345-0@lo:400:kworker.0 Request processed in 42us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117364.806074:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1789117364.806101:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117364.806131:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385455104:0@lo:400:kworker.0 00000100:00100000:1.0:1789117364.806143:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876025385455232:0@lo:400:kworker.0 00000100:00100000:1.0:1789117364.806168:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117364.806185:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117364.806192:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385455360:0@lo:400:kworker.0 00000100:00100000:1.0:1789117364.806220:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117364.806233:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385455360 00000100:00100000:3.0:1789117364.806239:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385455360 00000100:00100000:1.0:1789117364.806255:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789117364.806264:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385455616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117364.806301:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385455616:12345-0@lo:400:kworker.0 Request processed in 39us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117364.806311:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385454976 00000100:00100000:2.0:1789117364.806317:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385454976 00000100:00100000:2.0:1789117364.806354:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789117364.806363:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3299:x1876025385454976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117364.806432:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3299:x1876025385454976:12345-0@lo:400:kworker.0 Request processed in 70us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117364.806440:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00010000:00080000:0.0:1789117364.806468:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b7f67480 x1876025385455616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117364.806479:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385455616:0@lo:400:kworker.0 00000100:00080000:0.0:1789117364.806494:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789117364.806497:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789117364.806504:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385455488 00000100:00100000:0.0:1789117364.806508:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385455488 00000100:00100000:0.0:1789117364.806545:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789117364.806552:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178beca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876025385455488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117364.806598:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178beca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876025385455488:12345-0@lo:400:kworker.0 Request processed in 47us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117364.806604:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789117364.806644:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876025385455488:0@lo:400:kworker.0 00000100:00100000:0.0:1789117364.806653:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385454976:0@lo:400:kworker.0 00000100:00080000:2.0:1789117364.807160:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117364.809440:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789117364.809462:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178bec8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385455360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117364.809650:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178bec8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385455360:12345-0@lo:400:kworker.0 Request processed in 198us (3428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117364.809659:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789117364.811971:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1789117364.814622:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b7f64780 x1876025385455360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117364.814642:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385455360:0@lo:400:kworker.0 00010000:00010000:1.0:1789117365.061748:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117365.317595:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385455744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117365.317656:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117365.317722:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385455744 00000100:00100000:3.0:1789117365.317728:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385455744 00000100:00100000:3.0:1789117365.317767:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789117365.317775:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f65a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385455744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117365.317804:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117365.317840:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f65a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385455744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117365.317847:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789117365.317879:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b7f670c0 x1876025385455744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117365.317894:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385455744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117365.319707:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385455872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117365.319761:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117365.319806:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385455872 00000100:00100000:3.0:1789117365.319812:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385455872 00000100:00100000:3.0:1789117365.319848:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789117365.319855:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385455872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117365.319882:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117365.319914:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385455872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117365.319920:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789117365.319950:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b7f670c0 x1876025385455872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117365.319966:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385455872:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789117366.087559:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117367.110686:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117367.960760:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117367.960997:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362357632 00000100:00100000:1.0:1789117367.961006:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362357632 00000100:00100000:1.0:1789117367.961061:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 194 00000100:00100000:1.0:1789117367.961073:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2350:x1876025362357632:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117367.961179:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2350:x1876025362357632:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 107us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117367.961187:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 194 00000100:00100000:1.0:1789117367.963700:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117367.965022:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362357760 00000100:00100000:0.0:1789117367.965032:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362357760 00000100:00100000:0.0:1789117367.965105:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 36 00000100:00100000:0.0:1789117367.965116:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788841680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+6:2350:x1876025362357760:12345-192.168.206.37@tcp:400:kworker.0 00000100:00080000:2.0:1789117367.965161:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117367.965194:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788841680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+6:2350:x1876025362357760:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 80us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117367.965202:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 36 00000100:00100000:0.0:1789117367.972797:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117367.972890:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117367.972923:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362357888 00000100:00100000:2.0:1789117367.972930:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362358016 00000100:00100000:0.0:1789117367.972932:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362357888 00000100:00100000:2.0:1789117367.972957:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362358016 00000100:00100000:0.0:1789117367.972991:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 10 00000100:00100000:2.0:1789117367.973000:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 11 00000100:00100000:0.0:1789117367.973005:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+5:2348:x1876025362357888:12345-192.168.206.37@tcp:9:kworker.0 00000100:00100000:2.0:1789117367.973015:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+5:2348:x1876025362358016:12345-192.168.206.37@tcp:9:kworker.0 00000020:00000080:0.0:1789117367.973041:0:6685:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460dc02 00000100:00080000:0.0:1789117367.973051:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9c1787d4c000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1789117367.973054:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460dc09 00000100:00080000:2.0:1789117367.973064:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9c1787d4d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789117367.973101:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789117367.973428:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+2:2348:x1876025362357888:12345-192.168.206.37@tcp:9:kworker.0 Request processed in 426us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117367.973437:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 10 00000001:00000004:2.0:1789117367.976753:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789117367.977595:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+2:2348:x1876025362358016:12345-192.168.206.37@tcp:9:kworker.0 Request processed in 4577us (4696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117367.977607:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 11 00010000:00010000:1.0:1789117367.979228:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117367.980553:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789117367.980580:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117367.980586:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789117368.134516:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117369.159958:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117369.926639:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17a7d79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385456000:0@lo:400:kworker.0 00000100:00100000:3.0:1789117369.926708:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117369.926902:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681498f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876025385456256:0@lo:400:kworker.0 00000100:00100000:0.0:1789117369.926942:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117369.926966:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789117369.926972:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681498b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385456128:0@lo:400:kworker.0 00000100:00100000:0.0:1789117369.926993:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117369.927011:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681498780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385456640:0@lo:400:kworker.0 00000100:00100000:0.0:1789117369.927034:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117369.927060:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385456256 00000100:00100000:0.0:1789117369.927067:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385456256 00000100:00100000:0.0:1789117369.927112:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385456128 00000100:00100000:0.0:1789117369.927115:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385456128 00000100:00100000:0.0:1789117369.927136:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789117369.927144:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681499a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876025385456256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117369.927493:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385456000 00000100:00100000:1.0:1789117369.927497:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385456000 00000100:00100000:1.0:1789117369.927607:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789117369.927616:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3299:x1876025385456000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117369.927650:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3299:x1876025385456000:12345-0@lo:400:kworker.0 Request processed in 36us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117369.927656:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789117369.927686:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168149a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385456384:0@lo:400:kworker.0 00000100:00100000:1.0:1789117369.927708:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117369.927728:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117369.927733:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168149ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385456512:0@lo:400:kworker.0 00000100:00100000:1.0:1789117369.927765:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117369.927785:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385456640 00000100:00100000:1.0:1789117369.927789:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385456640 00000100:00100000:1.0:1789117369.927817:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385456384 00000100:00100000:1.0:1789117369.927820:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385456384 00000100:00100000:1.0:1789117369.927838:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789117369.927844:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16814992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385456640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117369.927873:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16814992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385456640:12345-0@lo:400:kworker.0 Request processed in 29us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117369.927879:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789117369.927888:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789117369.927894:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788842580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385456384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117369.927920:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788842580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385456384:12345-0@lo:400:kworker.0 Request processed in 27us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117369.927937:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789117369.927952:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385456512 00000100:00100000:1.0:1789117369.927955:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385456512 00000100:00100000:1.0:1789117369.927971:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789117369.927976:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681499e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385456128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117369.928009:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681499e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385456128:12345-0@lo:400:kworker.0 Request processed in 31us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117369.928014:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789117369.928029:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789117369.928034:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385456512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117369.928061:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385456512:12345-0@lo:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117369.928066:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789117369.928108:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168149ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385456512:0@lo:400:kworker.0 00010000:00080000:1.0:1789117369.928120:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c168149a940 x1876025385456384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117369.928130:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168149a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385456384:0@lo:400:kworker.0 00000100:00100000:0.0:1789117369.928919:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681499a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876025385456256:12345-0@lo:400:kworker.0 Request processed in 46us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117369.928928:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789117369.928957:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789117369.928962:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117369.928964:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117369.928994:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681498b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385456128:0@lo:400:kworker.0 00010000:00080000:0.0:1789117369.929007:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1681498780 x1876025385456640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117369.929016:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681498780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385456640:0@lo:400:kworker.0 00000100:00100000:0.0:1789117369.929027:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681498f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876025385456256:0@lo:400:kworker.0 00000100:00100000:0.0:1789117369.929057:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17a7d79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385456000:0@lo:400:kworker.0 00000001:02000400:2.0:1789117369.932057:0:9055:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg637-server.virtnet: executing yml_node 00010000:00010000:0.0:1789117370.182236:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117370.438912:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385456896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117370.439009:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117370.439078:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117370.439090:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385456768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117370.439119:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117370.439151:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385456896 00000100:00100000:1.0:1789117370.439158:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385456896 00000100:00100000:1.0:1789117370.439195:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385456768 00000100:00100000:1.0:1789117370.439198:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385456768 00000100:00100000:1.0:1789117370.439212:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789117370.439219:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16839592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385456896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117370.439264:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117370.439308:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16839592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385456896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117370.439315:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789117370.439331:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789117370.439338:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1683958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385456768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117370.439358:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117370.439388:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1683958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385456768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117370.439393:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789117370.439445:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b87ebc00 x1876025385456768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117370.439461:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385456768:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789117370.439490:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b7f670c0 x1876025385456896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117370.439502:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385456896:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789117371.205842:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789117371.566995:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e0c4e520-7af6-449d-969f-b46035974613 00000020:00000080:1.0:1789117371.567004:0:6713:0:(genops.c:885:class_export_put()) final put ffff9c1787d49000/e0c4e520-7af6-449d-969f-b46035974613 00000020:00000080:0.0:1789117371.567203:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1787d49000/e0c4e520-7af6-449d-969f-b46035974613 for lustre-OST0000 00000020:00000080:0.0:1789117371.567262:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c1787d4c000 for lustre-OST0000 00000001:00100000:0.0:1789117372.016119:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e0c4e520-7af6-449d-969f-b46035974613 00000020:00000080:0.0:1789117372.016129:0:7650:0:(genops.c:885:class_export_put()) final put ffff9c1787d4c800/e0c4e520-7af6-449d-969f-b46035974613 00000020:00000080:1.0:1789117372.016223:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1787d4c800/e0c4e520-7af6-449d-969f-b46035974613 for lustre-OST0001 00000020:00000080:1.0:1789117372.018941:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c1787d4d800 for lustre-OST0001 00010000:00010000:0.0:1789117372.229889:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117373.085731:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117373.085778:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117373.085878:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362358272 00000100:00100000:1.0:1789117373.085886:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362358272 00000100:00100000:1.0:1789117373.085955:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 40 00000100:00100000:1.0:1789117373.085966:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+6:2350:x1876025362358272:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117373.086035:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+6:2350:x1876025362358272:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 71us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117373.086042:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 40 00000100:00100000:2.0:1789117373.086219:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362358144 00000100:00100000:2.0:1789117373.086224:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362358144 00000100:00100000:2.0:1789117373.086276:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 196 00000100:00100000:2.0:1789117373.086284:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2350:x1876025362358144:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117373.086321:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2350:x1876025362358144:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 37us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117373.086328:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 196 00000100:00080000:3.0:1789117373.086586:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789117373.253671:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117374.277560:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789117374.751550:0:9250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.140 00000100:00100000:0.0:1789117375.049546:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789117375.049561:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385457024:0@lo:400:kworker.0 00000100:00100000:0.0:1789117375.049563:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876025385457280:0@lo:400:kworker.0 00000100:00100000:2.0:1789117375.049589:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385457408:0@lo:400:kworker.0 00000100:00100000:1.0:1789117375.049627:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117375.049627:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117375.049643:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117375.049689:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385457152:0@lo:400:kworker.0 00000100:00100000:2.0:1789117375.049690:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117375.049702:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385457536:0@lo:400:kworker.0 00000100:00100000:0.0:1789117375.049723:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117375.049726:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385457024 00000100:00100000:1.0:1789117375.049732:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385457024 00000100:00100000:2.0:1789117375.049743:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117375.049746:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789117375.049754:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385457664:0@lo:400:kworker.0 00000100:00100000:1.0:1789117375.049779:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789117375.049782:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117375.049789:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3299:x1876025385457024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117375.049792:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385457408 00000100:00100000:2.0:1789117375.049797:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385457408 00000100:00100000:0.0:1789117375.049814:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385457280 00000100:00100000:0.0:1789117375.049819:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385457280 00000100:00100000:1.0:1789117375.049838:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3299:x1876025385457024:12345-0@lo:400:kworker.0 Request processed in 51us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117375.049847:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789117375.049848:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385457664 00000100:00100000:2.0:1789117375.049853:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385457664 00000100:00100000:0.0:1789117375.049855:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385457152 00000100:00100000:0.0:1789117375.049859:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385457152 00000100:00100000:0.0:1789117375.049872:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385457536 00000100:00100000:0.0:1789117375.049877:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385457536 00000100:00100000:0.0:1789117375.049898:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789117375.049904:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789117375.049914:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179305ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385457408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117375.049957:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789117375.049964:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179305ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385457408:12345-0@lo:400:kworker.0 Request processed in 50us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117375.050156:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681498780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876025385457280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117375.050196:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681498780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876025385457280:12345-0@lo:400:kworker.0 Request processed in 44us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117375.050202:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789117375.050205:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385457664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117375.050217:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789117375.050222:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681498b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385457152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117375.050236:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385457664:12345-0@lo:400:kworker.0 Request processed in 33us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117375.050243:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681498b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385457152:12345-0@lo:400:kworker.0 Request processed in 22us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117375.050255:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789117375.050268:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789117375.050273:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179305f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385457536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117375.050303:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179305f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385457536:12345-0@lo:400:kworker.0 Request processed in 31us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117375.050309:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1789117375.050351:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c179305da40 x1876025385457664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117375.050363:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385457664:0@lo:400:kworker.0 00000100:00100000:0.0:1789117375.050373:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876025385457280:0@lo:400:kworker.0 00000100:00100000:0.0:1789117375.050382:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385457152:0@lo:400:kworker.0 00000100:00100000:0.0:1789117375.050746:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385457024:0@lo:400:kworker.0 00000100:00080000:0.0:1789117375.051472:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117375.051571:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789117375.051574:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117375.053776:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789117375.053880:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385457536:0@lo:400:kworker.0 00010000:00080000:2.0:1789117375.053902:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b86b2580 x1876025385457408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117375.053914:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385457408:0@lo:400:kworker.0 00000100:00100000:1.0:1789117375.054837:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1789117375.302160:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117375.558260:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117375.558280:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385457792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117375.558340:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117375.558391:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385457792 00000100:00100000:2.0:1789117375.558419:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385457792 00000100:00100000:2.0:1789117375.558459:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789117375.558466:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179305c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385457792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789117375.558498:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789117375.558549:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179305c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385457792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117375.558556:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1789117375.558590:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c179305e1c0 x1876025385457792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117375.558607:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385457792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117375.560104:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385457920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117375.560293:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117375.561267:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385457920 00000100:00100000:0.0:1789117375.561275:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385457920 00000100:00100000:0.0:1789117375.561319:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789117375.561328:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179305e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385457920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789117375.561362:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789117375.564883:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179305e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385457920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3547us (4580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117375.564897:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1789117375.566597:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b7f661c0 x1876025385457920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117375.566624:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385457920:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789117376.325612:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789117377.195596:0:9348:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.140 00010000:00010000:2.0:1789117377.349636:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117378.216170:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117378.216239:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117378.216259:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362358400 00000100:00100000:3.0:1789117378.216270:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362358400 00000100:00100000:2.0:1789117378.216273:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362358528 00000100:00100000:2.0:1789117378.216279:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362358528 00000100:00100000:3.0:1789117378.216325:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 198 00000100:00100000:2.0:1789117378.216330:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 44 00000100:00100000:3.0:1789117378.216339:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2351:x1876025362358400:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117378.216344:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362358528:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117378.216433:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362358528:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 94us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117378.216441:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 44 00000100:00080000:2.0:1789117378.216460:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117378.219742:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2351:x1876025362358400:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 3396us (3568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117378.219773:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 198 00010000:00010000:0.0:1789117378.373778:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789117379.371760:0:9445:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.140 00010000:00010000:1.0:1789117379.397727:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117380.167161:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168149a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876025385458304:0@lo:400:kworker.0 00000100:00100000:1.0:1789117380.167245:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168149a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385458176:0@lo:400:kworker.0 00000100:00100000:0.0:1789117380.167246:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117380.167306:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117380.167335:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168149bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385458688:0@lo:400:kworker.0 00000100:00100000:0.0:1789117380.167337:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385458304 00000100:00100000:0.0:1789117380.167355:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385458304 00000100:00100000:1.0:1789117380.167365:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117380.167443:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385458176 00000100:00100000:0.0:1789117380.167446:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385458176 00000100:00100000:1.0:1789117380.167466:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385458688 00000100:00100000:0.0:1789117380.167471:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789117380.167472:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385458688 00000100:00100000:0.0:1789117380.167481:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16814983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876025385458304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117380.167524:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789117380.167534:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168395a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385458688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117380.167549:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16814983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876025385458304:12345-0@lo:400:kworker.0 Request processed in 69us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117380.167557:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789117380.167578:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789117380.167585:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168395a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385458688:12345-0@lo:400:kworker.0 Request processed in 52us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117380.167588:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168395b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385458176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117380.167599:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789117380.167622:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168395b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385458176:12345-0@lo:400:kworker.0 Request processed in 37us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117380.167630:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1789117380.167651:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789117380.167656:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168149a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385458176:0@lo:400:kworker.0 00000100:00080000:0.0:1789117380.167656:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117380.167683:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168149a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876025385458304:0@lo:400:kworker.0 00010000:00080000:1.0:1789117380.167809:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c168149bc00 x1876025385458688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117380.167822:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168149bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385458688:0@lo:400:kworker.0 00000100:00100000:2.0:1789117380.167830:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168149b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385458432:0@lo:400:kworker.0 00000100:00100000:2.0:1789117380.167862:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117380.167890:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789117380.167895:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168149b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385458048:0@lo:400:kworker.0 00000100:00100000:2.0:1789117380.167917:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117380.167939:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681499680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385458560:0@lo:400:kworker.0 00000100:00100000:2.0:1789117380.167958:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117380.168727:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385458048 00000100:00100000:0.0:1789117380.168734:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385458048 00000100:00100000:0.0:1789117380.168817:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789117380.168825:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3298:x1876025385458048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117380.168882:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3298:x1876025385458048:12345-0@lo:400:kworker.0 Request processed in 57us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117380.168888:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789117380.168978:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168149b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385458048:0@lo:400:kworker.0 00000100:00100000:1.0:1789117380.170125:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385458432 00000100:00100000:1.0:1789117380.170145:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385458432 00000100:00100000:1.0:1789117380.170213:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789117380.170222:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385458432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117380.170286:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385458432:12345-0@lo:400:kworker.0 Request processed in 65us (2422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117380.170293:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789117380.170316:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385458560 00000100:00100000:1.0:1789117380.170320:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385458560 00000100:00100000:1.0:1789117380.170345:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789117380.170352:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385458560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117380.170393:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385458560:12345-0@lo:400:kworker.0 Request processed in 42us (2434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117380.170427:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789117380.170461:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681499680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385458560:0@lo:400:kworker.0 00010000:00080000:1.0:1789117380.170475:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c168149b0c0 x1876025385458432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117380.170486:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168149b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385458432:0@lo:400:kworker.0 00000100:00080000:3.0:1789117380.170657:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117380.170662:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789117380.423968:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117380.678562:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117380.678583:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385458816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117380.678652:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117380.678732:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385458816 00000100:00100000:2.0:1789117380.678739:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385458816 00000100:00100000:2.0:1789117380.678796:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789117380.678816:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385458816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789117380.678859:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789117380.678904:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385458816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117380.678911:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1789117380.678948:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c02aa580 x1876025385458816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117380.678964:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385458816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117380.679199:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117380.679211:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168395a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385458944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117380.679240:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117380.679587:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385458944 00000100:00100000:0.0:1789117380.679593:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385458944 00000100:00100000:0.0:1789117380.679617:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789117380.679623:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168395b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385458944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789117380.679643:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789117380.679688:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168395b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385458944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117380.679695:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1789117380.679770:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c168395a1c0 x1876025385458944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117380.679785:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168395a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385458944:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1789117380.841380:0:9493:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 11 05:02:58 EDT 2026 00010000:00010000:1.0:1789117381.445892:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117382.469522:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117383.321833:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117383.321873:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117383.321935:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362358656 00000100:00100000:3.0:1789117383.321943:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362358656 00000100:00100000:3.0:1789117383.321995:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 200 00000100:00100000:3.0:1789117383.322005:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2352:x1876025362358656:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117383.322072:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2352:x1876025362358656:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 69us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117383.322080:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 200 00000100:00100000:0.0:1789117383.322749:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362358784 00000100:00100000:0.0:1789117383.322755:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362358784 00000100:00100000:0.0:1789117383.322817:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 48 00000100:00100000:0.0:1789117383.322826:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1683959680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2352:x1876025362358784:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117383.322871:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1683959680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2352:x1876025362358784:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 47us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117383.322877:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 48 00000100:00080000:3.0:1789117383.323120:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789117383.498369:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117384.517558:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117385.286855:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385459072:0@lo:400:kworker.0 00000100:00100000:2.0:1789117385.286864:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385459456:0@lo:400:kworker.0 00000100:00100000:2.0:1789117385.287174:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117385.287194:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117385.287244:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876025385459584:0@lo:400:kworker.0 00000100:00100000:2.0:1789117385.287247:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385459200:0@lo:400:kworker.0 00000100:00100000:3.0:1789117385.287281:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117385.287326:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117385.287343:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385459712:0@lo:400:kworker.0 00000100:00100000:2.0:1789117385.287363:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117385.287379:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117385.287386:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385459328:0@lo:400:kworker.0 00000100:00100000:3.0:1789117385.287390:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385459072 00000100:00100000:2.0:1789117385.287443:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117385.287481:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385459584 00000100:00100000:2.0:1789117385.287486:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385459584 00000100:00100000:2.0:1789117385.287546:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385459200 00000100:00100000:2.0:1789117385.287549:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385459200 00000100:00100000:3.0:1789117385.287561:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385459072 00000100:00100000:2.0:1789117385.287566:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385459328 00000100:00100000:2.0:1789117385.287570:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385459328 00000100:00100000:2.0:1789117385.287592:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789117385.287603:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789117385.287608:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876025385459584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117385.287614:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3299:x1876025385459072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117385.287671:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876025385459584:12345-0@lo:400:kworker.0 Request processed in 65us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117385.287674:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3299:x1876025385459072:12345-0@lo:400:kworker.0 Request processed in 63us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117385.287684:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789117385.287687:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789117385.287708:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789117385.287716:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385459200:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789117385.287720:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117385.287747:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385459072:0@lo:400:kworker.0 00000100:00100000:3.0:1789117385.287761:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876025385459584:0@lo:400:kworker.0 00000100:00100000:3.0:1789117385.287926:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789117385.287935:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385459328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117385.287973:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385459328:12345-0@lo:400:kworker.0 Request processed in 40us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117385.287979:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789117385.288076:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385459328:0@lo:400:kworker.0 00000100:00100000:2.0:1789117385.288179:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385459200:12345-0@lo:400:kworker.0 Request processed in 463us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117385.288186:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789117385.288212:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385459200:0@lo:400:kworker.0 00000100:00100000:1.0:1789117385.288330:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385459456 00000100:00100000:1.0:1789117385.288335:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385459456 00000100:00100000:1.0:1789117385.288378:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385459712 00000100:00100000:1.0:1789117385.288381:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385459712 00000100:00100000:1.0:1789117385.288428:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789117385.288435:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385459456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117385.288488:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385459456:12345-0@lo:400:kworker.0 Request processed in 53us (1314us total) trans 0 rc 0/0 00000100:00080000:3.0:1789117385.288495:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789117385.288501:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117385.288508:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789117385.288529:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789117385.288535:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385459712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117385.288586:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385459712:12345-0@lo:400:kworker.0 Request processed in 51us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117385.288591:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789117385.288634:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c02a8b40 x1876025385459456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1789117385.288645:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c02aa940 x1876025385459712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117385.288648:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385459456:0@lo:400:kworker.0 00000100:00100000:3.0:1789117385.288665:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385459712:0@lo:400:kworker.0 00010000:00010000:1.0:1789117385.549014:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117385.797806:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385459840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117385.797871:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117385.798192:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385459968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117385.798222:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117385.798317:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385459840 00000100:00100000:1.0:1789117385.798324:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385459840 00000100:00100000:1.0:1789117385.798357:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385459968 00000100:00100000:1.0:1789117385.798360:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385459968 00000100:00100000:1.0:1789117385.798376:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789117385.798384:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385459840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117385.798452:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117385.798513:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385459840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117385.798519:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789117385.798535:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789117385.798541:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385459968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117385.798558:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117385.798587:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385459968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117385.798605:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1789117385.799075:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c02aa940 x1876025385459968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117385.799093:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385459968:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789117385.799124:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c02a92c0 x1876025385459840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117385.799137:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385459840:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789117386.565767:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117387.589705:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117388.441167:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117388.441219:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117388.441278:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362358912 00000100:00100000:3.0:1789117388.441295:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362358912 00000100:00100000:3.0:1789117388.441373:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 202 00000100:00100000:3.0:1789117388.441385:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2351:x1876025362358912:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117388.441523:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2351:x1876025362358912:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 139us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117388.441532:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 202 00000100:00100000:3.0:1789117388.441641:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362359040 00000100:00100000:3.0:1789117388.441647:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362359040 00000100:00100000:3.0:1789117388.441703:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 52 00000100:00100000:3.0:1789117388.441712:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168395bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362359040:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117388.441749:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168395bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362359040:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 39us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117388.441782:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 52 00000100:00080000:3.0:1789117388.441803:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789117388.613910:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117389.637519:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117390.413745:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385460096:0@lo:400:kworker.0 00000100:00100000:3.0:1789117390.413816:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117390.413919:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385460224:0@lo:400:kworker.0 00000100:00100000:3.0:1789117390.413949:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117390.413960:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385460096 00000100:00100000:1.0:1789117390.413967:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385460096 00000100:00100000:3.0:1789117390.413990:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876025385460352:0@lo:400:kworker.0 00000100:00100000:1.0:1789117390.414007:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789117390.414085:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3299:x1876025385460096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117390.414136:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3299:x1876025385460096:12345-0@lo:400:kworker.0 Request processed in 121us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117390.414143:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789117390.414173:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385460224 00000100:00100000:1.0:1789117390.414176:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385460224 00000100:00100000:1.0:1789117390.414200:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789117390.414206:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788843840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385460224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117390.414238:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788843840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385460224:12345-0@lo:400:kworker.0 Request processed in 32us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117390.414243:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789117390.414659:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385460096:0@lo:400:kworker.0 00000100:00100000:3.0:1789117390.415223:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117390.415298:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385460224:0@lo:400:kworker.0 00000100:00100000:3.0:1789117390.415735:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1785c09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385460480:0@lo:400:kworker.0 00000100:00100000:3.0:1789117390.415766:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117390.415810:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117390.415816:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1785c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385460608:0@lo:400:kworker.0 00000100:00100000:3.0:1789117390.415840:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117390.415873:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385460352 00000100:00100000:3.0:1789117390.415877:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385460352 00000100:00100000:3.0:1789117390.415916:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385460608 00000100:00100000:3.0:1789117390.415919:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385460608 00000100:00100000:3.0:1789117390.415937:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789117390.415944:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876025385460352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117390.415987:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876025385460352:12345-0@lo:400:kworker.0 Request processed in 43us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117390.415993:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789117390.416007:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789117390.416014:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385460608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117390.416056:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385460608:12345-0@lo:400:kworker.0 Request processed in 42us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117390.416062:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1789117390.416078:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117390.416097:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876025385460352:0@lo:400:kworker.0 00000100:00100000:3.0:1789117390.416119:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1785c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385460608:0@lo:400:kworker.0 00000100:00100000:3.0:1789117390.416149:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1785c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385460736:0@lo:400:kworker.0 00000100:00100000:3.0:1789117390.416172:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117390.420002:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385460480 00000100:00100000:1.0:1789117390.420085:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385460480 00000100:00100000:1.0:1789117390.420145:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385460736 00000100:00100000:1.0:1789117390.420149:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385460736 00000100:00100000:1.0:1789117390.420172:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789117390.420181:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385460480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117390.420267:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385460480:12345-0@lo:400:kworker.0 Request processed in 86us (4498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117390.420886:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789117390.420908:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789117390.420917:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385460736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117390.420965:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385460736:12345-0@lo:400:kworker.0 Request processed in 51us (4791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117390.420970:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789117390.421259:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117390.421265:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789117390.421524:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1785c09e00 x1876025385460480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117390.421541:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1785c09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385460480:0@lo:400:kworker.0 00010000:00080000:1.0:1789117390.421577:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1785c08000 x1876025385460736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117390.421586:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1785c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385460736:0@lo:400:kworker.0 00010000:00010000:2.0:1789117390.662563:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117390.917884:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385460864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117390.917947:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117390.918021:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385460864 00000100:00100000:2.0:1789117390.918028:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385460864 00000100:00100000:2.0:1789117390.918070:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789117390.918079:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385460864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789117390.918110:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789117390.918149:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385460864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117390.918156:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1789117390.918195:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c02a83c0 x1876025385460864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117390.918213:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385460864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117390.919089:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385460992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117390.919130:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117390.919694:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385460992 00000100:00100000:0.0:1789117390.919701:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385460992 00000100:00100000:0.0:1789117390.919740:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789117390.919748:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385460992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789117390.919774:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789117390.919815:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385460992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117390.919822:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789117390.919946:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c02a83c0 x1876025385460992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117390.919961:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385460992:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789117391.686078:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117392.709851:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117393.560724:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117393.560758:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117393.560785:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362359296 00000100:00100000:2.0:1789117393.560793:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362359296 00000100:00100000:2.0:1789117393.560844:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 56 00000100:00100000:2.0:1789117393.560854:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2350:x1876025362359296:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117393.560914:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2350:x1876025362359296:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 62us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117393.560921:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 56 00000100:00080000:2.0:1789117393.561010:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117393.561181:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362359168 00000100:00100000:3.0:1789117393.561186:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362359168 00000100:00100000:3.0:1789117393.561214:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 204 00000100:00100000:3.0:1789117393.561221:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2350:x1876025362359168:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117393.561245:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2350:x1876025362359168:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 25us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117393.561251:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 204 00010000:00010000:1.0:1789117393.734549:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789117393.827337:0:10124:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 05:03:11 (1789117391) === 00000100:00100000:1.0:1789117394.225973:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117394.226082:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362359424 00000100:00100000:2.0:1789117394.226092:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362359424 00000100:00100000:2.0:1789117394.226146:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 205 00000100:00100000:2.0:1789117394.226156:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:8137:x1876025362359424:12345-192.168.206.37@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789117394.226171:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117394.226189:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178457f000/0xf7565228e460dccd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c6d4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117394.226217:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178457f000/0xf7565228e460dccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6d4 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117394.226245:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178457f000/0xf7565228e460dccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6d4 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117394.226254:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f000, rc 0) 00000100:00100000:2.0:1789117394.226312:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:8137:x1876025362359424:12345-192.168.206.37@tcp:101:mount.lustre.0 Request processed in 158us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117394.226320:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 205 00000100:00100000:2.0:1789117394.237218:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117394.237305:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362359552 00000100:00100000:3.0:1789117394.237315:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362359552 00000100:00100000:3.0:1789117394.237366:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 206 00000100:00100000:3.0:1789117394.237386:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:8137:x1876025362359552:12345-192.168.206.37@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789117394.237719:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:8137:x1876025362359552:12345-192.168.206.37@tcp:501:mount.lustre.0 Request processed in 343us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117394.237727:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 206 00000100:00100000:0.0:1789117394.240692:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117394.240824:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362359680 00000100:00100000:3.0:1789117394.240833:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362359680 00000100:00100000:3.0:1789117394.240901:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 207 00000100:00100000:3.0:1789117394.240910:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:8137:x1876025362359680:12345-192.168.206.37@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789117394.241112:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:8137:x1876025362359680:12345-192.168.206.37@tcp:503:mount.lustre.0 Request processed in 202us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117394.241121:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 207 00000100:00100000:1.0:1789117394.249479:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117394.249572:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362359808 00000100:00100000:2.0:1789117394.249580:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362359808 00000100:00100000:2.0:1789117394.249632:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 208 00000100:00100000:2.0:1789117394.249642:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:8141:x1876025362359808:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789117394.249919:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:8141:x1876025362359808:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 278us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117394.249927:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 208 00000100:00100000:2.0:1789117394.268516:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117394.268611:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362359936 00000100:00100000:1.0:1789117394.268620:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362359936 00000100:00100000:1.0:1789117394.268670:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 209 00000100:00100000:1.0:1789117394.268680:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:8141:x1876025362359936:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789117394.268962:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:8141:x1876025362359936:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 282us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117394.268979:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 209 00000100:00100000:0.0:1789117394.274639:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117394.275586:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362360064 00000100:00100000:3.0:1789117394.275597:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362360064 00000100:00100000:3.0:1789117394.275661:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 210 00000100:00100000:3.0:1789117394.275671:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:8137:x1876025362360064:12345-192.168.206.37@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789117394.275691:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117394.275709:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178149c200/0xf7565228e460dcd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c6fe expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117394.275736:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178149c200/0xf7565228e460dcd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6fe expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117394.275747:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178149c200/0xf7565228e460dcd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6fe expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117394.275755:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178149c200, rc 0) 00000100:00100000:3.0:1789117394.275822:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:8137:x1876025362360064:12345-192.168.206.37@tcp:101:mount.lustre.0 Request processed in 153us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117394.275829:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 210 00000100:00100000:3.0:1789117394.282165:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117394.282499:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362360192 00000100:00100000:2.0:1789117394.282509:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362360192 00000100:00100000:2.0:1789117394.282559:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 211 00000100:00100000:2.0:1789117394.282569:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:8137:x1876025362360192:12345-192.168.206.37@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789117394.282592:0:5834:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789117394.282615:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789117394.282619:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789117394.282628:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789117394.282630:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789117394.284685:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:8137:x1876025362360192:12345-192.168.206.37@tcp:256:mount.lustre.0 Request processed in 2109us (2521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117394.284698:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 211 00000100:00100000:0.0:1789117394.288543:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117394.289450:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362360320 00000100:00100000:1.0:1789117394.289461:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362360320 00000100:00100000:1.0:1789117394.289519:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 212 00000100:00100000:1.0:1789117394.289528:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:8137:x1876025362360320:12345-192.168.206.37@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789117394.289543:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117394.289559:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1781684c00/0xf7565228e460dcdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c705 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117394.289588:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1781684c00/0xf7565228e460dcdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c705 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117394.289599:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1781684c00/0xf7565228e460dcdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c705 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117394.289607:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781684c00, rc 0) 00000100:00100000:1.0:1789117394.290063:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:8137:x1876025362360320:12345-192.168.206.37@tcp:101:mount.lustre.0 Request processed in 532us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117394.290073:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 212 00000100:00100000:3.0:1789117394.294695:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117394.294928:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362360448 00000100:00100000:1.0:1789117394.294937:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362360448 00000100:00100000:1.0:1789117394.294990:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 213 00000100:00100000:1.0:1789117394.294999:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:8137:x1876025362360448:12345-192.168.206.37@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789117394.295297:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:8137:x1876025362360448:12345-192.168.206.37@tcp:501:mount.lustre.0 Request processed in 298us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117394.295305:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 213 00000100:00100000:2.0:1789117394.297669:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117394.297987:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362360576 00000100:00100000:1.0:1789117394.297996:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362360576 00000100:00100000:1.0:1789117394.298049:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 214 00000100:00100000:1.0:1789117394.298059:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:8137:x1876025362360576:12345-192.168.206.37@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789117394.298460:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:8137:x1876025362360576:12345-192.168.206.37@tcp:503:mount.lustre.0 Request processed in 401us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117394.298470:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 214 00000100:00100000:0.0:1789117394.302609:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117394.302691:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362360704 00000100:00100000:3.0:1789117394.302700:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362360704 00000100:00100000:3.0:1789117394.302764:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 215 00000100:00100000:3.0:1789117394.302774:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:8145:x1876025362360704:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789117394.303002:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:8145:x1876025362360704:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 228us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117394.303010:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 215 00000100:00100000:3.0:1789117394.305959:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117394.306051:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362360832 00000100:00100000:1.0:1789117394.306060:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362360832 00000100:00100000:1.0:1789117394.306144:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 216 00000100:00100000:1.0:1789117394.306154:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:8145:x1876025362360832:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789117394.306379:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:8145:x1876025362360832:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 225us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117394.306388:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 216 00000100:00100000:1.0:1789117394.311110:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117394.311156:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117394.311266:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362360960 00000100:00100000:3.0:1789117394.311276:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362360960 00000100:00100000:3.0:1789117394.311320:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362361344 00000100:00100000:3.0:1789117394.311324:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362361344 00000100:00100000:3.0:1789117394.311364:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 57 00000100:00100000:3.0:1789117394.311382:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1683958780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362361344:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117394.311384:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 10 00000100:00100000:0.0:1789117394.311431:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168395ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1876025362360960:12345-192.168.206.37@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789117394.311457:0:5839:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc@192.168.206.37@tcp t0 exp 0000000000000000 cur 241 last 0 00000100:00100000:3.0:1789117394.311494:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1683958780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362361344:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 119us (336us total) trans 0 rc 0/0 00000020:00000080:0.0:1789117394.311495:0:5839:0:(genops.c:1385:class_connect()) connect: client 7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc, cookie 0xf7565228e460dce2 00000100:00100000:3.0:1789117394.311506:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 57 00000004:00100000:0.0:1789117394.311528:0:5839:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789117394.311788:0:5839:0:(import.c:65:import_set_state_nolock()) ffff9c16816b4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789117394.311832:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168395ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:2348:x1876025362360960:12345-192.168.206.37@tcp:38:mount.lustre.0 Request processed in 435us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117394.311840:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 10 00000100:00100000:1.0:1789117394.319738:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117394.320290:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362361088 00000100:00100000:3.0:1789117394.320300:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362361088 00000100:00100000:3.0:1789117394.320375:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 11 00000100:00100000:3.0:1789117394.320386:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1683959a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:0:x1876025362361088:12345-192.168.206.37@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789117394.320469:0:7242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789117394.320556:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1683959a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:0:x1876025362361088:12345-192.168.206.37@tcp:41:mount.lustre.0 Request processed in 171us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117394.320563:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 11 00000100:00080000:2.0:1789117394.320847:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117394.322495:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117394.322659:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362361216 00000100:00100000:1.0:1789117394.322667:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362361216 00000100:00100000:1.0:1789117394.322717:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 12 00000100:00100000:1.0:1789117394.322727:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:8137:x1876025362361216:12345-192.168.206.37@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789117394.322756:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789117394.322836:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:8137:x1876025362361216:12345-192.168.206.37@tcp:41:mount.lustre.0 Request processed in 109us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117394.322844:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 12 00000100:00100000:2.0:1789117394.327463:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117394.327599:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362361472 00000100:00100000:3.0:1789117394.327608:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362361472 00000100:00100000:3.0:1789117394.327677:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 13 00000100:00100000:3.0:1789117394.327687:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:8137:x1876025362361472:12345-192.168.206.37@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789117394.327780:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:8137:x1876025362361472:12345-192.168.206.37@tcp:40:mount.lustre.0 Request processed in 94us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117394.327787:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 13 00000100:00100000:1.0:1789117394.337352:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117394.337445:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117394.337485:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117394.337565:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362361856 00000100:00100000:2.0:1789117394.337574:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362361856 00000100:00100000:2.0:1789117394.337633:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 1 00000100:00100000:2.0:1789117394.337642:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1683959e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:8137:x1876025362361856:12345-192.168.206.37@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789117394.337869:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1789117394.337870:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362361600 00000100:00100000:3.0:1789117394.337875:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362361600 00000100:00100000:3.0:1789117394.337892:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362361728 00000100:00100000:3.0:1789117394.337895:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362361728 00000100:00100000:3.0:1789117394.337909:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 12 00000100:00100000:3.0:1789117394.337914:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168395a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1876025362361600:12345-192.168.206.37@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789117394.337936:0:8269:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc@192.168.206.37@tcp t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:3.0:1789117394.337965:0:8269:0:(genops.c:1385:class_connect()) connect: client 7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc, cookie 0xf7565228e460dce9 00002000:00100000:3.0:1789117394.337975:0:8269:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc/ffff9c17b86d9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789117394.338006:0:8269:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789117394.338015:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1683959e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:8137:x1876025362361856:12345-192.168.206.37@tcp:33:mount.lustre.0 Request processed in 374us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117394.338022:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 1 00002000:00080000:3.0:1789117394.338183:0:8269:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789117394.338212:0:8269:0:(import.c:65:import_set_state_nolock()) ffff9c17b86d8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789117394.338241:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168395a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:2348:x1876025362361600:12345-192.168.206.37@tcp:8:mount.lustre.0 Request processed in 326us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117394.338248:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 12 00000100:00100000:3.0:1789117394.338262:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 13 00000100:00100000:3.0:1789117394.338266:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1683958f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1876025362361728:12345-192.168.206.37@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789117394.338293:0:8269:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc@192.168.206.37@tcp t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:3.0:1789117394.338313:0:8269:0:(genops.c:1385:class_connect()) connect: client 7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc, cookie 0xf7565228e460dcf0 00002000:00100000:3.0:1789117394.338319:0:8269:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc/ffff9c17b86df000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789117394.338338:0:8269:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789117394.338508:0:8269:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789117394.338526:0:8269:0:(import.c:65:import_set_state_nolock()) ffff9c17c03a1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789117394.338551:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1683958f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:2348:x1876025362361728:12345-192.168.206.37@tcp:8:mount.lustre.0 Request processed in 283us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117394.338558:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 13 00010000:00010000:2.0:1789117394.758829:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117395.527717:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385461120:0@lo:400:kworker.0 00000100:00100000:2.0:1789117395.527787:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117395.527830:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876025385461632:0@lo:400:kworker.0 00000100:00100000:2.0:1789117395.527855:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117395.527881:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117395.527887:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385461504:0@lo:400:kworker.0 00000100:00100000:3.0:1789117395.528106:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876025385461376:0@lo:400:kworker.0 00000100:00100000:3.0:1789117395.528135:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117395.528155:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789117395.528161:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385461248:0@lo:400:kworker.0 00000100:00100000:3.0:1789117395.528181:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117395.528196:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b862a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385461760:0@lo:400:kworker.0 00000100:00100000:3.0:1789117395.528217:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117395.528246:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385461632 00000100:00100000:3.0:1789117395.528252:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385461632 00000100:00100000:3.0:1789117395.528296:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385461376 00000100:00100000:3.0:1789117395.528299:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385461376 00000100:00100000:3.0:1789117395.528312:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385461248 00000100:00100000:3.0:1789117395.528315:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385461248 00000100:00100000:3.0:1789117395.528327:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789117395.528335:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b862a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876025385461632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117395.528382:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b862a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876025385461632:12345-0@lo:400:kworker.0 Request processed in 47us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117395.528390:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789117395.528442:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789117395.528448:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876025385461376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117395.528635:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117395.528703:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876025385461632:0@lo:400:kworker.0 00000100:00100000:2.0:1789117395.528727:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385461120 00000100:00100000:2.0:1789117395.528730:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385461120 00000100:00100000:2.0:1789117395.528756:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789117395.528762:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3299:x1876025385461120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117395.528796:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3299:x1876025385461120:12345-0@lo:400:kworker.0 Request processed in 33us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117395.528809:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789117395.528838:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789117395.528845:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385461248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117395.528880:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385461248:12345-0@lo:400:kworker.0 Request processed in 35us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117395.528887:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1789117395.528987:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117395.529013:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385461248:0@lo:400:kworker.0 00000100:00100000:2.0:1789117395.529035:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385461120:0@lo:400:kworker.0 00000100:00100000:3.0:1789117395.529290:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876025385461376:12345-0@lo:400:kworker.0 Request processed in 840us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117395.529296:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789117395.529698:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385461760 00000100:00100000:0.0:1789117395.529703:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385461760 00000100:00100000:0.0:1789117395.529755:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385461504 00000100:00100000:0.0:1789117395.529758:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385461504 00000100:00100000:0.0:1789117395.529780:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789117395.529787:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385461760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117395.529824:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385461760:12345-0@lo:400:kworker.0 Request processed in 38us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117395.529830:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789117395.529844:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789117395.529849:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b862b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385461504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117395.529878:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b862b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385461504:12345-0@lo:400:kworker.0 Request processed in 29us (1243us total) trans 0 rc 0/0 00000100:00080000:2.0:1789117395.529972:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789117395.529985:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789117395.530011:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c02a92c0 x1876025385461504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117395.530023:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385461504:0@lo:400:kworker.0 00000100:00100000:0.0:1789117395.530147:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789117395.530270:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b862a580 x1876025385461760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117395.530280:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b862a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385461760:0@lo:400:kworker.0 00000100:00100000:3.0:1789117395.530293:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876025385461376:0@lo:400:kworker.0 00010000:00010000:1.0:1789117395.784995:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117396.037499:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789117396.037519:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168149b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385462016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117396.037579:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117396.039014:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b8629680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385461888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117396.039078:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117396.039999:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385462016 00000100:00100000:1.0:1789117396.040008:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385462016 00000100:00100000:1.0:1789117396.040043:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385461888 00000100:00100000:1.0:1789117396.040046:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385461888 00000100:00100000:1.0:1789117396.040062:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789117396.040070:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168149bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385462016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117396.040106:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117396.040172:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168149bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385462016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (2592us total) trans 0 rc 0/0 00010000:00080000:2.0:1789117396.040279:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c168149b840 x1876025385462016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117396.040299:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168149b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385462016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117396.040337:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789117396.040355:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789117396.040362:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168149a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385461888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117396.040386:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117396.040456:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168149a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385461888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117396.040463:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789117396.040470:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b8629680 x1876025385461888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117396.040484:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b8629680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385461888:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789117396.806724:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789117397.137255:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc 00000001:00100000:0.0:1789117397.620568:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc 00000001:00100000:0.0:1789117397.637996:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc 00010000:00010000:1.0:1789117397.832741:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789117398.753317:0:10323:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg637-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1789117398.854348:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117399.704840:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117399.704891:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117399.704927:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117399.704952:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117399.704978:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117399.705004:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362362496 00000100:00100000:1.0:1789117399.705012:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362362496 00000100:00100000:1.0:1789117399.705064:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362362368 00000100:00100000:1.0:1789117399.705068:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362362368 00000100:00100000:1.0:1789117399.705092:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 34 00000100:00100000:1.0:1789117399.705102:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168395a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362362496:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117399.705167:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168395a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362362496:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 66us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117399.705174:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 34 00000100:00100000:1.0:1789117399.705191:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 35 00000100:00100000:1.0:1789117399.705198:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362362368:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117399.705220:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362362368:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 24us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117399.705226:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 35 00000100:00100000:2.0:1789117399.705346:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362362240 00000100:00100000:2.0:1789117399.705350:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362362240 00000100:00100000:2.0:1789117399.705378:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362362112 00000100:00100000:2.0:1789117399.705386:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362362112 00000100:00100000:2.0:1789117399.705445:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 61 00000100:00100000:2.0:1789117399.705452:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16839583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362362240:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117399.705482:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16839583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362362240:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 31us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117399.705488:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 61 00000100:00100000:2.0:1789117399.705501:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 62 00000100:00100000:2.0:1789117399.705506:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1683958b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362362112:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117399.705527:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1683958b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362362112:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 22us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117399.705534:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 62 00000100:00100000:3.0:1789117399.708210:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362361984 00000100:00080000:1.0:1789117399.708222:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117399.708229:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789117399.708231:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117399.708418:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362361984 00000100:00100000:3.0:1789117399.708477:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 218 00000100:00100000:3.0:1789117399.708490:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2351:x1876025362361984:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117399.708615:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2351:x1876025362361984:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 128us (3782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117399.708623:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 218 00010000:00010000:2.0:1789117399.880264:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117400.645844:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168149ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876025385462400:0@lo:400:kworker.0 00000100:00100000:1.0:1789117400.645898:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168149a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385462272:0@lo:400:kworker.0 00000100:00100000:0.0:1789117400.645921:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117400.645940:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117400.645986:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681499680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385462784:0@lo:400:kworker.0 00000100:00100000:3.0:1789117400.646016:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168149b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385462528:0@lo:400:kworker.0 00000100:00100000:1.0:1789117400.646016:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117400.646055:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117400.646062:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385462400 00000100:00100000:3.0:1789117400.646082:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789117400.646083:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385462400 00000100:00100000:3.0:1789117400.646090:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681498f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385462144:0@lo:400:kworker.0 00000100:00100000:3.0:1789117400.646119:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117400.646139:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385462272 00000100:00100000:1.0:1789117400.646143:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385462272 00000100:00100000:3.0:1789117400.646147:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168149b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385462656:0@lo:400:kworker.0 00000100:00100000:1.0:1789117400.646167:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789117400.646173:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117400.646178:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168149b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876025385462400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117400.646222:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168149b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876025385462400:12345-0@lo:400:kworker.0 Request processed in 48us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117400.646228:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789117400.646242:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385462656 00000100:00100000:1.0:1789117400.646244:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385462656 00000100:00100000:1.0:1789117400.646273:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789117400.646280:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385462272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117400.646301:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168149ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876025385462400:0@lo:400:kworker.0 00000100:00100000:1.0:1789117400.646331:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385462272:12345-0@lo:400:kworker.0 Request processed in 51us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117400.646337:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789117400.646347:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385462656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117400.646424:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385462656:12345-0@lo:400:kworker.0 Request processed in 54us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117400.646430:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789117400.646459:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168149b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385462656:0@lo:400:kworker.0 00000100:00100000:2.0:1789117400.646541:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385462144 00000100:00100000:2.0:1789117400.646546:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385462144 00000100:00100000:2.0:1789117400.646575:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789117400.646582:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3298:x1876025385462144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117400.646618:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3298:x1876025385462144:12345-0@lo:400:kworker.0 Request processed in 36us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117400.646625:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789117400.646660:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681498f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385462144:0@lo:400:kworker.0 00000100:00100000:3.0:1789117400.646732:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168149a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385462272:0@lo:400:kworker.0 00000100:00100000:1.0:1789117400.646894:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789117400.646913:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385462784 00000100:00100000:1.0:1789117400.646917:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385462784 00000100:00100000:1.0:1789117400.646950:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385462528 00000100:00100000:1.0:1789117400.646953:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385462528 00000100:00100000:1.0:1789117400.646982:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789117400.646989:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385462784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117400.647032:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385462784:12345-0@lo:400:kworker.0 Request processed in 44us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117400.647038:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789117400.647048:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789117400.647054:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385462528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117400.647081:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385462528:12345-0@lo:400:kworker.0 Request processed in 27us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117400.647096:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1789117400.647116:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789117400.647120:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117400.647122:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789117400.647346:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1681499680 x1876025385462784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117400.647357:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681499680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385462784:0@lo:400:kworker.0 00010000:00080000:2.0:1789117400.647393:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c168149b480 x1876025385462528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117400.647435:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168149b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385462528:0@lo:400:kworker.0 00010000:00010000:3.0:1789117400.905236:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117401.157754:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117401.157778:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385462912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117401.157844:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117401.158018:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385462912 00000100:00100000:2.0:1789117401.158025:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385462912 00000100:00100000:2.0:1789117401.158073:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789117401.158082:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385462912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789117401.158114:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789117401.158156:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385462912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117401.158163:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1789117401.158197:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b86283c0 x1876025385462912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117401.158213:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385462912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117401.158726:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789117401.158738:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168149b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385463040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117401.158770:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117401.158956:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385463040 00000100:00100000:0.0:1789117401.158961:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385463040 00000100:00100000:0.0:1789117401.159084:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789117401.159092:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c0a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385463040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789117401.159117:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789117401.159161:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c0a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385463040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117401.159181:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1789117401.159237:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c168149b840 x1876025385463040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117401.159250:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168149b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385463040:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789117401.926570:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117402.949980:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117403.977458:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117404.825495:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117404.825580:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117404.825612:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117404.825632:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117404.825690:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362363008 00000100:00100000:2.0:1789117404.825700:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362363008 00000100:00100000:2.0:1789117404.825763:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 38 00000100:00100000:2.0:1789117404.825775:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d51a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362363008:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117404.825843:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d51a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362363008:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 70us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117404.825851:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 38 00000100:00100000:3.0:1789117404.825866:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362362624 00000100:00100000:3.0:1789117404.825872:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362362624 00000100:00080000:2.0:1789117404.825877:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117404.825909:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 220 00000100:00100000:3.0:1789117404.825916:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2351:x1876025362362624:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117404.825944:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2351:x1876025362362624:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 29us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117404.825951:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 220 00000100:00100000:0.0:1789117404.827425:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362362752 00000100:00100000:0.0:1789117404.827434:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362362752 00000100:00100000:0.0:1789117404.827532:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362362880 00000100:00100000:0.0:1789117404.827536:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362362880 00000100:00100000:3.0:1789117404.827586:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 66 00000100:00100000:3.0:1789117404.827596:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362362752:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117404.827664:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362362752:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 70us (2176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117404.827672:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 66 00000100:00100000:3.0:1789117404.827734:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00080000:1.0:1789117404.828995:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117404.829147:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 67 00000100:00100000:0.0:1789117404.829158:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362362880:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117404.829222:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362362880:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 66us (3588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117404.829228:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 67 00000100:00100000:0.0:1789117404.829251:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362363136 00000100:00100000:0.0:1789117404.829257:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362363136 00000100:00080000:1.0:1789117404.830453:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789117404.830609:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 39 00000100:00100000:0.0:1789117404.830620:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362363136:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117404.830694:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362363136:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 67us (2950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117404.830701:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 39 00010000:00010000:2.0:1789117404.999880:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117405.766623:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b8628780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385463552:0@lo:400:kworker.0 00000100:00100000:2.0:1789117405.766687:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117405.766748:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789117405.766755:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b8628f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385463168:0@lo:400:kworker.0 00000100:00100000:2.0:1789117405.766799:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117405.766823:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b8629a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385463680:0@lo:400:kworker.0 00000100:00100000:2.0:1789117405.766848:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117405.766873:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b862a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385463296:0@lo:400:kworker.0 00000100:00100000:2.0:1789117405.766897:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117405.766914:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b8629e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385463808:0@lo:400:kworker.0 00000100:00100000:2.0:1789117405.766933:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117405.766949:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117405.766954:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b862ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385463424:0@lo:400:kworker.0 00000100:00100000:2.0:1789117405.766976:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117405.767002:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385463552 00000100:00100000:2.0:1789117405.767008:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385463552 00000100:00100000:2.0:1789117405.767054:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385463808 00000100:00100000:2.0:1789117405.767058:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385463808 00000100:00100000:2.0:1789117405.767076:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789117405.767085:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385463552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117405.767134:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385463552:12345-0@lo:400:kworker.0 Request processed in 49us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117405.767142:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789117405.767159:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789117405.767166:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b862b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385463808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117405.767200:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b862b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385463808:12345-0@lo:400:kworker.0 Request processed in 36us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117405.767207:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789117405.767235:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385463168 00000100:00100000:2.0:1789117405.767239:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385463168 00000100:00100000:2.0:1789117405.767260:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789117405.767267:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3298:x1876025385463168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117405.767299:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3298:x1876025385463168:12345-0@lo:400:kworker.0 Request processed in 32us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117405.767305:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789117405.767331:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385463680 00000100:00100000:2.0:1789117405.767334:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385463680 00000100:00100000:2.0:1789117405.767370:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385463296 00000100:00100000:2.0:1789117405.767373:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385463296 00000100:00100000:2.0:1789117405.767384:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385463424 00000100:00100000:2.0:1789117405.767386:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385463424 00000100:00100000:2.0:1789117405.767417:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789117405.767423:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385463680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117405.767460:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385463680:12345-0@lo:400:kworker.0 Request processed in 37us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117405.767466:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789117405.767479:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789117405.767484:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b862b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385463296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117405.767508:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b862b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385463296:12345-0@lo:400:kworker.0 Request processed in 24us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117405.767514:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789117405.767524:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789117405.767530:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8628b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385463424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117405.767571:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8628b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385463424:12345-0@lo:400:kworker.0 Request processed in 41us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117405.767586:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1789117405.767615:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789117405.767619:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789117405.767622:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117405.767660:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b862ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385463424:0@lo:400:kworker.0 00000100:00100000:2.0:1789117405.767673:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b862a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385463296:0@lo:400:kworker.0 00010000:00080000:2.0:1789117405.767689:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b8629e00 x1876025385463808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117405.767700:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b8628f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385463168:0@lo:400:kworker.0 00000100:00100000:2.0:1789117405.767703:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b8629e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385463808:0@lo:400:kworker.0 00000100:00100000:3.0:1789117405.767721:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b8629a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385463680:0@lo:400:kworker.0 00010000:00080000:3.0:1789117405.767736:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b8628780 x1876025385463552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117405.767765:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b8628780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385463552:0@lo:400:kworker.0 00010000:00010000:0.0:1789117406.021539:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117406.277912:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117406.277934:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1785c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385463936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117406.277995:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117406.278108:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385463936 00000100:00100000:3.0:1789117406.278114:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385463936 00000100:00100000:3.0:1789117406.278165:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789117406.278173:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8629e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385463936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117406.278220:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117406.278274:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8629e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385463936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117406.278282:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1789117406.278623:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1785c08000 x1876025385463936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117406.278641:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1785c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385463936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117406.279256:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117406.279267:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1785c09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385464064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117406.279305:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117406.279647:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385464064 00000100:00100000:3.0:1789117406.279653:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385464064 00000100:00100000:3.0:1789117406.280205:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789117406.280221:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385464064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117406.280254:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117406.280313:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385464064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117406.280320:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1789117406.280515:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1785c09e00 x1876025385464064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117406.280537:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1785c09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385464064:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789117407.046588:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117408.069908:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117409.095331:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117409.947169:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117409.947219:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117409.947255:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117409.947274:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117409.947510:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362363264 00000100:00100000:1.0:1789117409.947520:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362363264 00000100:00100000:1.0:1789117409.947569:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 222 00000100:00100000:1.0:1789117409.947580:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2350:x1876025362363264:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117409.947670:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2350:x1876025362363264:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 92us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117409.947679:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 222 00000100:00100000:3.0:1789117409.947989:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117409.948217:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362363520 00000100:00100000:3.0:1789117409.948222:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362363520 00000100:00100000:3.0:1789117409.948263:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362363392 00000100:00100000:3.0:1789117409.948267:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362363392 00000100:00100000:3.0:1789117409.948300:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 71 00000100:00100000:3.0:1789117409.948308:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2350:x1876025362363520:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117409.948364:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2350:x1876025362363520:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 57us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117409.948371:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 71 00000100:00100000:3.0:1789117409.948384:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 72 00000100:00100000:3.0:1789117409.948391:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+6:2350:x1876025362363392:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117409.948444:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+6:2350:x1876025362363392:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 53us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117409.948451:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 72 00000100:00100000:3.0:1789117409.948470:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362363776 00000100:00100000:3.0:1789117409.948473:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362363776 00000100:00100000:3.0:1789117409.948497:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362363648 00000100:00100000:3.0:1789117409.948500:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362363648 00000100:00100000:3.0:1789117409.948520:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 42 00000100:00100000:3.0:1789117409.948526:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c013dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2350:x1876025362363776:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117409.948551:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c013dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2350:x1876025362363776:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 26us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117409.948557:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 42 00000100:00100000:3.0:1789117409.948719:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 43 00000100:00100000:3.0:1789117409.948726:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2350:x1876025362363648:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117409.950502:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2350:x1876025362363648:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 1768us (2505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117409.950514:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 43 00000100:00080000:3.0:1789117409.951503:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789117409.951521:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789117409.951525:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789117410.117595:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117410.892126:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681499680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385464320:0@lo:400:kworker.0 00000100:00100000:0.0:1789117410.892189:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117410.892243:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c16814992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385464832:0@lo:400:kworker.0 00000100:00100000:0.0:1789117410.892269:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117410.892312:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789117410.892341:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168149a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385464448:0@lo:400:kworker.0 00000100:00100000:0.0:1789117410.892367:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117410.892419:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385464320 00000100:00100000:0.0:1789117410.892426:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385464320 00000100:00100000:0.0:1789117410.892468:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385464448 00000100:00100000:0.0:1789117410.892471:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385464448 00000100:00100000:0.0:1789117410.892504:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789117410.892513:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385464320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117410.892567:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385464320:12345-0@lo:400:kworker.0 Request processed in 56us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117410.892575:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789117410.892595:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789117410.892602:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168149a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385464448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117410.892631:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168149a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385464448:12345-0@lo:400:kworker.0 Request processed in 30us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117410.892637:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789117410.892826:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681498f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385464576:0@lo:400:kworker.0 00000100:00100000:3.0:1789117410.892860:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117410.892883:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789117410.892890:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168149b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385464192:0@lo:400:kworker.0 00000100:00100000:3.0:1789117410.892917:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117410.892939:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168149b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385464704:0@lo:400:kworker.0 00000100:00100000:3.0:1789117410.892961:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117410.892983:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385464832 00000100:00100000:3.0:1789117410.892987:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385464832 00000100:00100000:3.0:1789117410.893017:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385464576 00000100:00100000:3.0:1789117410.893020:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385464576 00000100:00100000:3.0:1789117410.893040:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789117410.893048:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168149ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385464832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117410.893081:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168149ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385464832:12345-0@lo:400:kworker.0 Request processed in 34us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117410.893088:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789117410.893100:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789117410.893107:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385464576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117410.893136:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385464576:12345-0@lo:400:kworker.0 Request processed in 30us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117410.893143:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789117410.893160:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385464192 00000100:00100000:3.0:1789117410.893163:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385464192 00000100:00100000:3.0:1789117410.893186:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789117410.893192:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3298:x1876025385464192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117410.893231:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3298:x1876025385464192:12345-0@lo:400:kworker.0 Request processed in 38us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117410.893237:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789117410.893299:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168149b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385464192:0@lo:400:kworker.0 00010000:00080000:3.0:1789117410.893314:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1681498f00 x1876025385464576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117410.893325:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681498f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385464576:0@lo:400:kworker.0 00000100:00100000:0.0:1789117410.893757:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385464704 00000100:00100000:0.0:1789117410.893762:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385464704 00000100:00100000:0.0:1789117410.893784:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789117410.893790:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385464704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117410.893824:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385464704:12345-0@lo:400:kworker.0 Request processed in 34us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117410.893829:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1789117410.893854:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789117410.893858:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117410.893860:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117410.893880:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168149a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385464448:0@lo:400:kworker.0 00000100:00100000:0.0:1789117410.893899:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681499680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385464320:0@lo:400:kworker.0 00010000:00080000:0.0:1789117410.893909:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c16814992c0 x1876025385464832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117410.893918:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c16814992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385464832:0@lo:400:kworker.0 00000100:00100000:3.0:1789117410.893996:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168149b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385464704:0@lo:400:kworker.0 00010000:00010000:3.0:1789117411.142606:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117411.397754:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385464960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117411.397826:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117411.397961:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385464960 00000100:00100000:1.0:1789117411.397968:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385464960 00000100:00100000:1.0:1789117411.398017:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789117411.398027:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16814992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385464960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117411.398062:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117411.398115:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16814992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385464960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117411.398122:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1789117411.398201:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c1d53480 x1876025385464960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117411.398219:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385464960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117411.399560:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1785c0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385465088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117411.399609:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117411.399711:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385465088 00000100:00100000:2.0:1789117411.399717:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385465088 00000100:00100000:2.0:1789117411.399762:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789117411.399771:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681499680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385465088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789117411.399795:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789117411.399837:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681499680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385465088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117411.399844:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1789117411.399912:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1785c0bc00 x1876025385465088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117411.399928:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1785c0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385465088:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789117412.166499:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789117412.417746:0:11023:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789117413.191296:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117414.214659:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117415.067365:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117415.067431:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117415.067458:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117415.067484:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362364160 00000100:00100000:0.0:1789117415.067492:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362364160 00000100:00100000:0.0:1789117415.067542:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362364032 00000100:00100000:0.0:1789117415.067546:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362364032 00000100:00100000:0.0:1789117415.067568:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 76 00000100:00100000:0.0:1789117415.067578:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168149a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362364160:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117415.067664:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168149a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362364160:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 87us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117415.067672:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 76 00000100:00100000:0.0:1789117415.067690:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 77 00000100:00100000:0.0:1789117415.067697:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168149b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362364032:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117415.067731:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168149b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362364032:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 35us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117415.067738:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 77 00000100:00080000:0.0:1789117415.067759:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117415.067920:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362363904 00000100:00100000:1.0:1789117415.067925:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362363904 00000100:00100000:1.0:1789117415.067965:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 224 00000100:00100000:1.0:1789117415.067972:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2351:x1876025362363904:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117415.068005:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2351:x1876025362363904:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 34us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117415.068011:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 224 00000100:00100000:1.0:1789117415.093119:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117415.093156:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117415.093184:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362364288 00000100:00100000:1.0:1789117415.093192:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362364288 00000100:00100000:1.0:1789117415.093259:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362364416 00000100:00100000:1.0:1789117415.093263:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362364416 00000100:00100000:1.0:1789117415.093287:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 14 00000100:00100000:1.0:1789117415.093297:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d51680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2348:x1876025362364288:12345-192.168.206.37@tcp:9:kworker.0 00000020:00000080:1.0:1789117415.093348:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460dce9 00000100:00080000:1.0:1789117415.093356:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9c17b86d8800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789117415.093391:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789117415.093709:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d51680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+2:2348:x1876025362364288:12345-192.168.206.37@tcp:9:kworker.0 Request processed in 413us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117415.093717:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 14 00000100:00100000:1.0:1789117415.093733:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 15 00000100:00100000:1.0:1789117415.093740:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d53c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2348:x1876025362364416:12345-192.168.206.37@tcp:9:kworker.0 00000020:00000080:1.0:1789117415.093752:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460dcf0 00000100:00080000:1.0:1789117415.093757:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9c17c03a1000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789117415.093776:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789117415.093945:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d53c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+2:2348:x1876025362364416:12345-192.168.206.37@tcp:9:kworker.0 Request processed in 205us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117415.093952:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 15 00010000:00010000:1.0:1789117415.093972:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117415.093977:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789117415.096549:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117415.096558:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789117415.238662:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789117415.322840:0:11170:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff154e2d80 20000000:00000080:2.0:1789117415.322862:0:11170:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c178455c800 uarg=0000000000000000 20000000:01000000:2.0:1789117415.322896:0:11170:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789117415.322901:0:11170:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789117415.322906:0:11170:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789117415.323709:0:11171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789117415.323839:0:11170:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789117415.332616:0:11170:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789117415.333051:0:11170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c178149d000/0xf7565228e460dcf7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117415.333073:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178457f800/0xf7565228e460dc9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6cd expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117415.333081:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178457ec00/0xf7565228e460dcaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dca3 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117415.333087:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1781685200/0xf7565228e460dcb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dcb1 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117415.333094:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178457e800/0xf7565228e460dcc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dcbf expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117415.333101:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1781684c00/0xf7565228e460dcdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c705 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117415.333122:0:11170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c178149d000/0xf7565228e460dcf7 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117415.333162:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1781684c00/0xf7565228e460dcdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c705 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117415.333177:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1781684c00/0xf7565228e460dcdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c705 expref: 12 pid: 5833 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117415.333190:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1785c08b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1876025385465216:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117415.333294:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178457e800/0xf7565228e460dcc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460dcbf expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117415.333303:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c178457e800/0xf7565228e460dcc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460dcbf expref: 18 pid: 5834 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117415.333321:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1785c08780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1876025385465344:0@lo:104: 00000100:00100000:3.0:1789117415.333358:0:11170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117415.333428:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1781685200/0xf7565228e460dcb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460dcb1 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117415.333437:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1781685200/0xf7565228e460dcb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460dcb1 expref: 18 pid: 5834 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117415.333446:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1785c0ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1876025385465472:0@lo:104: 00000100:00100000:3.0:1789117415.333468:0:11170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117415.333495:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178457ec00/0xf7565228e460dcaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460dca3 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117415.333513:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c178457ec00/0xf7565228e460dcaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460dca3 expref: 18 pid: 5833 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117415.333523:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1876025385465600:0@lo:104: 00000100:00100000:3.0:1789117415.333545:0:11170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117415.333564:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178457f800/0xf7565228e460dc9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6cd expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117415.333572:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c178457f800/0xf7565228e460dc9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6cd expref: 12 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117415.333580:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1876025385465728:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117415.333602:0:11170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178303a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117415.334759:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385465344 00000100:00100000:2.0:1789117415.334769:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385465344 00000100:00100000:2.0:1789117415.334809:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385465472 00000100:00100000:2.0:1789117415.334811:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385465472 00000100:00100000:2.0:1789117415.334820:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385465600 00000100:00100000:2.0:1789117415.334823:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385465600 00000100:00100000:2.0:1789117415.334836:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789117415.334844:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+5:11170:x1876025385465344:12345-0@lo:104: 00010000:00010000:2.0:1789117415.334858:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460dcbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dcc6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.334922:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789117415.334928:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+5:11170:x1876025385465344:12345-0@lo:104: Request processed in 85us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117415.334936:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789117415.334953:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789117415.334959:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+4:11170:x1876025385465472:12345-0@lo:104: 00010000:00010000:2.0:1789117415.334966:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460dcb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dcb8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.335014:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789117415.335019:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+4:11170:x1876025385465472:12345-0@lo:104: Request processed in 61us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117415.335038:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789117415.335051:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789117415.335057:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:11170:x1876025385465600:12345-0@lo:104: 00010000:00010000:2.0:1789117415.335063:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c1787cbda00/0xf7565228e460dca3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dcaa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.335090:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789117415.335094:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:11170:x1876025385465600:12345-0@lo:104: Request processed in 39us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117415.335100:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1789117415.335117:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789117415.335123:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460dcbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dcc6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.335130:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e400 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:2.0:1789117415.335134:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460dcbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460dcc6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.335142:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460dcbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460dcc6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117415.335150:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460dcbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460dcc6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117415.335156:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789117415.335187:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460dcbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dcc6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.335194:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117415.335224:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460dcbf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dcc6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.335230:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460dcbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dcc6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.335243:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789117415.335246:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460dcb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dcb8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.335250:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685600 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:2.0:1789117415.335253:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460dcb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460dcb8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.335258:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460dcb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460dcb8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117415.335427:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460dcb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460dcb8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117415.335432:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789117415.335448:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460dcb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dcb8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.335454:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117415.335468:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460dcb1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dcb8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.335476:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c1781685600/0xf7565228e460dcb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dcb8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.335487:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117415.335495:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c1787cbda00/0xf7565228e460dca3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dcaa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.335502:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbda00 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:2.0:1789117415.335505:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c1787cbda00/0xf7565228e460dca3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460dcaa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.335511:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c1787cbda00/0xf7565228e460dca3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460dcaa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117415.335517:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c1787cbda00/0xf7565228e460dca3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460dcaa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117415.335523:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789117415.335536:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c1787cbda00/0xf7565228e460dca3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dcaa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.335542:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117415.335548:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c1787cbda00/0xf7565228e460dca3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dcaa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.335555:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c1787cbda00/0xf7565228e460dca3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dcaa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.335567:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117415.335568:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117415.335570:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117415.335579:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117415.335596:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b862bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385465856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117415.335640:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117415.335683:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b8629680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385465984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117415.335716:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117415.335737:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117415.335742:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385466112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117415.335764:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117415.335788:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385465856 00000100:00100000:2.0:1789117415.335792:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385465856 00010000:00010000:2.0:1789117415.335812:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178457e800/0xf7565228e460dcc6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dcbf expref: 19 pid: 5834 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117415.335829:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385465984 00000100:00100000:2.0:1789117415.335832:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385465984 00010000:00010000:2.0:1789117415.335841:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1781685200/0xf7565228e460dcb8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dcb1 expref: 20 pid: 5834 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117415.335849:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385466112 00000100:00100000:2.0:1789117415.335852:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385466112 00010000:00010000:2.0:1789117415.335860:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178457ec00/0xf7565228e460dcaa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dca3 expref: 21 pid: 5833 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117415.335870:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789117415.335876:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17845e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+21:3299:x1876025385465856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789117415.335884:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117415.335889:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178457e800/0xf7565228e460dcc6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dcbf expref: 21 pid: 5834 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.335897:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178457e800/0xf7565228e460dcc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460dcbf expref: 21 pid: 5834 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.335912:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117415.335940:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17845e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+21:3299:x1876025385465856:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117415.335952:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789117415.335993:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789117415.336001:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b862b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+20:3300:x1876025385465984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789117415.336008:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117415.336013:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1781685200/0xf7565228e460dcb8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dcb1 expref: 20 pid: 5834 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.336020:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1781685200/0xf7565228e460dcb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460dcb1 expref: 20 pid: 5834 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.336029:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117415.336055:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b862b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+20:3300:x1876025385465984:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117415.336061:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789117415.336074:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789117415.336080:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86292c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385466112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789117415.336088:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117415.336092:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178457ec00/0xf7565228e460dcaa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dca3 expref: 19 pid: 5833 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.336100:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178457ec00/0xf7565228e460dcaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460dca3 expref: 19 pid: 5833 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117415.336110:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117415.336131:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86292c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385466112:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117415.336136:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789117415.336177:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b862bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385465856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117415.336210:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385466112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117415.336217:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b8629680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385465984:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789117415.338914:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178457e800/0xf7565228e460dcc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460dcbf expref: 18 pid: 5834 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117415.338931:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1785c08780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1876025385465344:0@lo:104: 00010000:00010000:2.0:1789117415.338942:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1781685200/0xf7565228e460dcb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460dcb1 expref: 17 pid: 5834 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117415.338952:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1785c0ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1876025385465472:0@lo:104: 00010000:00010000:2.0:1789117415.338961:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178457ec00/0xf7565228e460dcaa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460dca3 expref: 16 pid: 5833 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117415.338969:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1876025385465600:0@lo:104: 00000100:00100000:2.0:1789117415.339849:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1785c08b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1876025385465216:192.168.206.37@tcp:104: 00000100:00100000:2.0:1789117415.339863:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1876025385465728:192.168.206.37@tcp:104: 00010000:00010000:2.0:1789117415.339898:0:11170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c178149d000/0xf7565228e460dcf7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117415.340105:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117415.340130:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117415.340178:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362364544 00000100:00100000:2.0:1789117415.340185:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362364544 00010000:00010000:2.0:1789117415.340301:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1781684c00/0xf7565228e460dcdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c705 expref: 13 pid: 5833 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117415.340437:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362364672 00000100:00100000:2.0:1789117415.340441:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362364672 00010000:00010000:2.0:1789117415.340455:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178457f800/0xf7565228e460dc9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6cd expref: 14 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117415.340859:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 28 00000100:00100000:0.0:1789117415.340871:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681498f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+14:2349:x1876025362364544:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117415.340886:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117415.340892:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1781684c00/0xf7565228e460dcdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c705 expref: 14 pid: 5833 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117415.340903:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1781684c00/0xf7565228e460dcdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c705 expref: 14 pid: 5833 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117415.340919:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1781684c00/0xf7565228e460dcdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c705 expref: 14 pid: 5833 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117415.340933:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117415.340983:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681498f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2349:x1876025362364544:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 115us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117415.340990:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 28 00000100:00100000:0.0:1789117415.341011:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 29 00000100:00100000:0.0:1789117415.341017:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168149b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:2349:x1876025362364672:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117415.341024:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117415.341029:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178457f800/0xf7565228e460dc9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6cd expref: 12 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117415.341037:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178457f800/0xf7565228e460dc9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6cd expref: 12 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117415.341046:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178457f800/0xf7565228e460dc9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6cd expref: 12 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117415.341055:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c178149d000/0xf7565228e460dcf7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117415.341064:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178149d000/0xf7565228e460dcf7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117415.341076:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178149d000/0xf7565228e460dcf7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117415.341082:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178149d000/0xf7565228e460dcf7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117415.341088:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c178149d000/0xf7565228e460dcf7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117415.341094:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c178149d000/0xf7565228e460dcf7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117415.341106:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178149d000 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:0.0:1789117415.341109:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c178149d000/0xf7565228e460dcf7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117415.341117:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c178149d000/0xf7565228e460dcf7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117415.341132:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c178149d000/0xf7565228e460dcf7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117415.341142:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117415.341162:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168149b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:2349:x1876025362364672:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 145us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117415.341168:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 29 00010000:00010000:3.0:1789117415.343193:0:11170:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c178149d000/0xf7565228e460dcf7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117415.343208:0:11170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c178149d000/0xf7565228e460dcf7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117415.343229:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178149d000/0xf7565228e460dcf7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117416.006030:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876025385466368:0@lo:400:kworker.0 00000100:00100000:3.0:1789117416.006104:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117416.006160:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385466880:0@lo:400:kworker.0 00000100:00100000:1.0:1789117416.006166:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385466368 00000100:00100000:1.0:1789117416.006174:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385466368 00000100:00100000:3.0:1789117416.006188:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117416.006223:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789117416.006226:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789117416.006237:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876025385466368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117416.006242:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385466240:0@lo:400:kworker.0 00000100:00100000:3.0:1789117416.006276:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117416.006312:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876025385466368:12345-0@lo:400:kworker.0 Request processed in 66us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117416.006318:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876025385466752:0@lo:400:kworker.0 00000100:00100000:1.0:1789117416.006324:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789117416.006349:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117416.006352:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385466880 00000100:00100000:1.0:1789117416.006357:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385466880 00000100:00100000:3.0:1789117416.006383:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876025385466368:0@lo:400:kworker.0 00000100:00100000:1.0:1789117416.006424:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789117416.006432:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385466880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117416.006455:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385466496:0@lo:400:kworker.0 00000100:00100000:1.0:1789117416.006474:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385466880:12345-0@lo:400:kworker.0 Request processed in 44us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117416.006481:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789117416.006491:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117416.006519:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117416.006525:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385466624:0@lo:400:kworker.0 00000100:00100000:3.0:1789117416.006553:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117416.006601:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385466240 00000100:00100000:3.0:1789117416.006605:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385466240 00000100:00100000:3.0:1789117416.006639:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789117416.006648:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:3299:x1876025385466240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117416.006685:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:3299:x1876025385466240:12345-0@lo:400:kworker.0 Request processed in 39us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117416.006693:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789117416.007726:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385466752 00000100:00100000:1.0:1789117416.007733:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385466752 00000100:00100000:1.0:1789117416.007765:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385466496 00000100:00100000:1.0:1789117416.007768:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385466496 00000100:00100000:1.0:1789117416.007785:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789117416.007792:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178bec8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876025385466752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117416.007837:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178bec8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876025385466752:12345-0@lo:400:kworker.0 Request processed in 45us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117416.007844:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789117416.007857:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789117416.007863:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385466496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117416.007899:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385466496:12345-0@lo:400:kworker.0 Request processed in 35us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117416.007905:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385466624 00000100:00100000:1.0:1789117416.007906:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789117416.007912:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385466624 00000100:00080000:1.0:1789117416.007929:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789117416.007934:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117416.007936:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117416.007950:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789117416.007985:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385466240:0@lo:400:kworker.0 00000100:00100000:1.0:1789117416.007999:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876025385466752:0@lo:400:kworker.0 00010000:00080000:1.0:1789117416.008010:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c178be70b40 x1876025385466880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117416.008032:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385466880:0@lo:400:kworker.0 00000100:00100000:3.0:1789117416.008156:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788840f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385466624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117416.008193:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788840f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385466624:12345-0@lo:400:kworker.0 Request processed in 237us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117416.008200:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1789117416.008227:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b87e8780 x1876025385466624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117416.008249:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385466624:0@lo:400:kworker.0 00000100:00100000:3.0:1789117416.008263:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385466496:0@lo:400:kworker.0 00010000:00010000:2.0:1789117416.263942:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117416.520510:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d50f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385467008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117416.520598:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117416.520772:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385467008 00000100:00100000:1.0:1789117416.520779:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385467008 00000100:00100000:1.0:1789117416.520830:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789117416.520839:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385467008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117416.520875:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117416.520925:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385467008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117416.520932:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1789117416.520969:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c1d50f00 x1876025385467008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117416.520987:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d50f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385467008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117416.524873:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788842940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385467136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117416.524939:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117416.525057:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385467136 00000100:00100000:3.0:1789117416.525064:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385467136 00000100:00100000:3.0:1789117416.525114:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789117416.525124:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b862bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385467136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117416.525155:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117416.525726:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b862bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385467136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 602us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117416.525736:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1789117416.531548:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1788842940 x1876025385467136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117416.531575:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788842940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385467136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117416.729065:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117416.729245:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362364800 00000100:00100000:0.0:1789117416.729255:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362364800 00000100:00100000:0.0:1789117416.729317:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 226 00000100:00100000:0.0:1789117416.729327:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:5605:x1876025362364800:12345-192.168.206.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117416.729342:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117416.729513:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1787cbd800/0xf7565228e460dcfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c72f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117416.729543:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1787cbd800/0xf7565228e460dcfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c72f expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117416.729554:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1787cbd800/0xf7565228e460dcfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c72f expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117416.729582:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbd800, rc 0) 00000100:00100000:0.0:1789117416.729653:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:5605:x1876025362364800:12345-192.168.206.37@tcp:101:ll_cfg_requeue.0 Request processed in 327us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117416.729661:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 226 00000100:00100000:1.0:1789117416.732646:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117416.732734:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362364928 00000100:00100000:3.0:1789117416.732743:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362364928 00000100:00100000:3.0:1789117416.732803:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 227 00000100:00100000:3.0:1789117416.732814:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:5605:x1876025362364928:12345-192.168.206.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117416.733113:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:5605:x1876025362364928:12345-192.168.206.37@tcp:501:ll_cfg_requeue.0 Request processed in 300us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117416.733121:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 227 00000100:00100000:1.0:1789117416.735442:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117416.735494:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362365056 00000100:00100000:0.0:1789117416.735504:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362365056 00000100:00100000:0.0:1789117416.738230:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 228 00000100:00100000:0.0:1789117416.738252:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:5605:x1876025362365056:12345-192.168.206.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117416.738485:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:5605:x1876025362365056:12345-192.168.206.37@tcp:503:ll_cfg_requeue.0 Request processed in 242us (3052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117416.738493:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 228 00000100:00100000:1.0:1789117416.744017:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117416.744333:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362365184 00000100:00100000:0.0:1789117416.744353:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362365184 00000100:00100000:0.0:1789117416.744427:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 229 00000100:00100000:0.0:1789117416.744437:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:5605:x1876025362365184:12345-192.168.206.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117416.744452:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117416.744470:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1787cbde00/0xf7565228e460dd05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c736 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117416.744497:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1787cbde00/0xf7565228e460dd05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c736 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117416.744508:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1787cbde00/0xf7565228e460dd05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c736 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117416.744517:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbde00, rc 0) 00000100:00100000:0.0:1789117416.744578:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:5605:x1876025362365184:12345-192.168.206.37@tcp:101:ll_cfg_requeue.0 Request processed in 143us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117416.744586:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 229 00000100:00100000:1.0:1789117416.749033:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117416.749271:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362365312 00000100:00100000:3.0:1789117416.749281:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362365312 00000100:00100000:3.0:1789117416.749343:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 230 00000100:00100000:3.0:1789117416.749353:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:5605:x1876025362365312:12345-192.168.206.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117416.749666:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:5605:x1876025362365312:12345-192.168.206.37@tcp:501:ll_cfg_requeue.0 Request processed in 313us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117416.749675:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 230 00000100:00100000:1.0:1789117416.754181:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117416.754331:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362365440 00000100:00100000:3.0:1789117416.754340:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362365440 00000100:00100000:3.0:1789117416.754391:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 231 00000100:00100000:3.0:1789117416.754428:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:5605:x1876025362365440:12345-192.168.206.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117416.754644:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:5605:x1876025362365440:12345-192.168.206.37@tcp:503:ll_cfg_requeue.0 Request processed in 244us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117416.754652:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 231 10000000:01000000:2.0:1789117416.837459:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789117416.837467:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c16816f2800 from 7 10000000:01000000:2.0:1789117416.837473:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789117416.837515:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457f600/0xf7565228e460dd0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117416.837527:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178457f600/0xf7565228e460dd0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117416.837537:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178457f600/0xf7565228e460dd0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117416.837563:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b862b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385467264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789117416.837643:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117416.837696:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b799a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789117416.838379:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385467264 00000100:00100000:3.0:1789117416.838388:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385467264 00000100:00100000:3.0:1789117416.838469:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789117416.838479:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:5837:x1876025385467264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117416.838493:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117416.838506:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178149d000/0xf7565228e460dd13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dd0c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117416.838529:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178149d000/0xf7565228e460dd13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dd0c expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117416.838539:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178149d000/0xf7565228e460dd13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dd0c expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117416.838547:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178149d000, rc 0) 00000100:00100000:3.0:1789117416.838606:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385467264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117416.838613:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789117416.838766:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b862b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385467264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117416.838783:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178457f600/0xf7565228e460dd0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dd13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117416.838792:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178457f600/0xf7565228e460dd0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dd13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117416.838865:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b862b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385467392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117416.838894:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117416.838962:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b799a000 going to sleep for 11 seconds 00000100:00100000:1.0:1789117416.841978:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385467392 00000100:00100000:1.0:1789117416.841992:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385467392 00000100:00100000:1.0:1789117416.842064:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789117416.842082:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385467392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117416.842422:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385467392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 340us (3525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117416.842430:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789117416.844177:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b862b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385467392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117416.844234:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d50f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385467520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117416.844292:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117416.844341:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c179872a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789117416.844448:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385467520 00000100:00100000:3.0:1789117416.844454:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385467520 00000100:00100000:3.0:1789117416.844713:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789117416.844728:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385467520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117416.847086:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385467520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2350us (2785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117416.847099:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789117416.847197:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d50f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385467520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789117416.850353:0:11226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789117416.851029:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789117416.851052:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789117416.851063:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457f600/0xf7565228e460dd0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dd13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117416.851074:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178457f600/0xf7565228e460dd0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dd13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117416.851150:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789117416.851153:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c17c03a3800 from 7 10000000:01000000:1.0:1789117416.851156:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789117416.851192:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1781685200/0xf7565228e460dd1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117416.851199:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c1781685200/0xf7565228e460dd1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117416.851209:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c1781685200/0xf7565228e460dd1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117416.851318:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d50f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385467648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789117416.851384:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117416.851447:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c179872a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789117416.852544:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385467648 00000100:00100000:3.0:1789117416.852556:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385467648 00000100:00100000:3.0:1789117416.852615:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789117416.852627:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385467648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117416.852646:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117416.852667:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178149d600/0xf7565228e460dd21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dd1a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117416.852696:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178149d600/0xf7565228e460dd21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dd1a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117416.852709:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178149d600/0xf7565228e460dd21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dd1a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117416.852718:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178149d600, rc 0) 00000100:00100000:3.0:1789117416.853060:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385467648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 434us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117416.853064:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d50f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385467648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789117416.853072:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00010000:00010000:1.0:1789117416.853162:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c1781685200/0xf7565228e460dd1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dd21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117416.853175:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c1781685200/0xf7565228e460dd1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dd21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117416.853329:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d50f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385467776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117416.853366:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117416.853424:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c179872a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789117416.855172:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385467776 00000100:00100000:3.0:1789117416.855185:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385467776 00000100:00100000:3.0:1789117416.855237:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789117416.855247:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385467776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117416.856342:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385467776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1092us (2971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117416.856360:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789117416.860811:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d50f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385467776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117416.860879:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d50f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385467904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117416.860953:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117416.861000:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c179872a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789117416.861564:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385467904 00000100:00100000:3.0:1789117416.861571:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385467904 00000100:00100000:3.0:1789117416.861617:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789117416.861626:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385467904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117416.861820:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385467904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117416.861827:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789117416.861932:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d50f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385467904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789117416.862813:0:11227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789117416.862959:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789117416.862978:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117416.862987:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1781685200/0xf7565228e460dd1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dd21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117416.862997:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c1781685200/0xf7565228e460dd1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dd21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117416.863008:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789117416.863011:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c178548d000 from 7 10000000:01000000:3.0:1789117416.863014:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789117416.863043:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460dd28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117416.863050:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460dd28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117416.863058:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460dd28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117416.863075:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788841a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385468032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789117416.863126:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117416.863163:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787c05000 going to sleep for 11 seconds 00000100:00100000:1.0:1789117416.863727:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385468032 00000100:00100000:1.0:1789117416.863734:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385468032 00000100:00100000:1.0:1789117416.863776:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789117416.863785:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385468032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117416.863798:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117416.863818:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1781685400/0xf7565228e460dd2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dd28 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117416.863842:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1781685400/0xf7565228e460dd2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dd28 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117416.863853:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1781685400/0xf7565228e460dd2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dd28 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117416.863861:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685400, rc 0) 00000100:00100000:1.0:1789117416.863906:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385468032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117416.863913:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789117416.863992:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788841a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385468032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117416.864008:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460dd28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dd2f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117416.864018:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460dd28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dd2f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117416.864075:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788841a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385468160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117416.864104:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117416.864136:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787c05000 going to sleep for 11 seconds 00000100:00100000:1.0:1789117416.864180:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385468160 00000100:00100000:1.0:1789117416.864184:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385468160 00000100:00100000:1.0:1789117416.864212:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789117416.864218:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385468160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117416.864480:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385468160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117416.864488:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789117416.864566:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788841a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385468160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117416.864595:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788841a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385468288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117416.864632:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117416.864656:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787c05000 going to sleep for 11 seconds 00000100:00100000:1.0:1789117416.864810:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385468288 00000100:00100000:1.0:1789117416.864815:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385468288 00000100:00100000:1.0:1789117416.864844:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789117416.864851:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385468288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117416.864992:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385468288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117416.864999:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789117416.865102:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788841a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385468288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789117416.865903:0:11228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789117416.866077:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789117416.866095:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117416.866105:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460dd28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dd2f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117416.866116:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460dd28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dd2f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117417.285530:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789117417.610867:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc 00000020:00000080:1.0:1789117417.610887:0:6713:0:(genops.c:885:class_export_put()) final put ffff9c17b86d9800/7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc 00000020:00000080:2.0:1789117417.611093:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17b86d9800/7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc for lustre-OST0000 00000020:00000080:2.0:1789117417.615543:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c17b86d8800 for lustre-OST0000 00000001:00100000:1.0:1789117418.131480:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc 00000020:00000080:1.0:1789117418.131489:0:7650:0:(genops.c:885:class_export_put()) final put ffff9c17b86df000/7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc 00000020:00000080:1.0:1789117418.131513:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17b86df000/7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc for lustre-OST0001 00000020:00000080:1.0:1789117418.131549:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c17c03a1000 for lustre-OST0001 00010000:00010000:2.0:1789117418.311498:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789117418.719469:0:11370:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg637-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789117419.333550:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117420.186727:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117420.186766:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117420.186788:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117420.186986:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362365568 00000100:00100000:3.0:1789117420.186996:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362365568 00000100:00100000:3.0:1789117420.187047:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 241 00000100:00100000:3.0:1789117420.187069:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2352:x1876025362365568:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117420.187139:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2352:x1876025362365568:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 72us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117420.187146:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 241 00000100:00100000:3.0:1789117420.187182:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362365824 00000100:00100000:3.0:1789117420.187185:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362365824 00000100:00100000:3.0:1789117420.187218:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362365696 00000100:00100000:3.0:1789117420.187221:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362365696 00000100:00100000:3.0:1789117420.187259:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 81 00000100:00100000:3.0:1789117420.187267:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179305e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2352:x1876025362365824:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117420.187319:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179305e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2352:x1876025362365824:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 53us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117420.187326:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 81 00000100:00100000:3.0:1789117420.187337:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 82 00000100:00100000:3.0:1789117420.187343:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179305d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362365696:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117420.187609:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179305d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362365696:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 264us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117420.187616:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 82 00000100:00080000:3.0:1789117420.187633:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789117420.359124:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117421.125931:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385468672:0@lo:400:kworker.0 00000100:00100000:1.0:1789117421.125998:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117421.126050:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117421.126057:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385468800:0@lo:400:kworker.0 00000100:00100000:1.0:1789117421.126084:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117421.126285:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d50b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876025385468544:0@lo:400:kworker.0 00000100:00100000:3.0:1789117421.126316:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117421.126337:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385469056:0@lo:400:kworker.0 00000100:00100000:3.0:1789117421.126358:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117421.126383:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789117421.126389:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d50f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385468416:0@lo:400:kworker.0 00000100:00100000:3.0:1789117421.126450:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117421.126473:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876025385468928:0@lo:400:kworker.0 00000100:00100000:3.0:1789117421.126495:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117421.126523:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385468672 00000100:00100000:3.0:1789117421.126529:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385468672 00000100:00100000:3.0:1789117421.126573:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385468544 00000100:00100000:3.0:1789117421.126577:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385468544 00000100:00100000:3.0:1789117421.126589:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385468928 00000100:00100000:3.0:1789117421.126591:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385468928 00000100:00100000:3.0:1789117421.126607:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789117421.126615:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385468672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117421.126663:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385468672:12345-0@lo:400:kworker.0 Request processed in 49us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117421.126671:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789117421.126686:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789117421.126692:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788841e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876025385468544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117421.126723:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788841e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876025385468544:12345-0@lo:400:kworker.0 Request processed in 31us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117421.126729:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789117421.126738:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789117421.126743:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788841a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876025385468928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117421.126765:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788841a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876025385468928:12345-0@lo:400:kworker.0 Request processed in 22us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117421.126770:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789117421.126798:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385468416 00000100:00100000:3.0:1789117421.126801:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385468416 00000100:00100000:3.0:1789117421.126822:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789117421.126835:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3299:x1876025385468416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117421.126864:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3299:x1876025385468416:12345-0@lo:400:kworker.0 Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117421.126870:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:3.0:1789117421.126894:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117421.126924:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385468672:0@lo:400:kworker.0 00000100:00100000:3.0:1789117421.126946:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d50f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385468416:0@lo:400:kworker.0 00000100:00100000:3.0:1789117421.126954:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876025385468928:0@lo:400:kworker.0 00000100:00100000:3.0:1789117421.126962:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d50b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876025385468544:0@lo:400:kworker.0 00000100:00100000:1.0:1789117421.127344:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385468800 00000100:00100000:1.0:1789117421.127350:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385468800 00000100:00100000:1.0:1789117421.127384:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385469056 00000100:00100000:1.0:1789117421.127387:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385469056 00000100:00100000:1.0:1789117421.127491:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789117421.127499:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385468800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117421.127543:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385468800:12345-0@lo:400:kworker.0 Request processed in 46us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117421.127549:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789117421.127561:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789117421.127567:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788842580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385469056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117421.127596:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788842580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385469056:12345-0@lo:400:kworker.0 Request processed in 29us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117421.127602:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1789117421.127640:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c1d503c0 x1876025385468800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117421.127652:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385468800:0@lo:400:kworker.0 00010000:00080000:1.0:1789117421.127687:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c1d52580 x1876025385469056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117421.127696:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385469056:0@lo:400:kworker.0 00000100:00080000:3.0:1789117421.128249:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789117421.128255:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789117421.384688:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117421.638945:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385469184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117421.639031:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117421.639087:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385469184 00000100:00100000:2.0:1789117421.639099:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385469184 00000100:00100000:2.0:1789117421.639165:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789117421.639175:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385469184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789117421.639212:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789117421.639322:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385469184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117421.639331:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1789117421.639393:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c1d51a40 x1876025385469184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117421.639473:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385469184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117421.640386:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788842940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385469312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117421.640528:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117421.640894:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385469312 00000100:00100000:3.0:1789117421.640903:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385469312 00000100:00100000:3.0:1789117421.640966:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789117421.640979:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d52d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385469312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117421.641023:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117421.641081:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d52d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385469312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117421.641089:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1789117421.641135:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1788842940 x1876025385469312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117421.641157:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788842940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385469312:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789117422.406567:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117423.435441:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789117423.724966:0:11614:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5626c760 20000000:00000080:3.0:1789117423.724985:0:11614:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c17b8794800 uarg=0000000000000000 20000000:01000000:3.0:1789117423.725030:0:11614:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:3.0:1789117423.725036:0:11614:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:3.0:1789117423.725041:0:11614:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:0.0:1789117423.726063:0:11615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1789117423.726238:0:11614:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 in log params 00000040:00080000:3.0:1789117423.734257:0:11614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1789117423.734321:0:11614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 144 off9680 00000040:00080000:3.0:1789117423.734384:0:11614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9904 10000000:01000000:3.0:1789117423.734470:0:11614:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789117423.734492:0:11614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c178149d800/0xf7565228e460dd36 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117423.734513:0:11614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1787cbd800/0xf7565228e460dcfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c72f expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117423.734522:0:11614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1787cbde00/0xf7565228e460dd05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c736 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117423.734530:0:11614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178149d000/0xf7565228e460dd13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dd0c expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117423.734537:0:11614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178149d600/0xf7565228e460dd21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dd1a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117423.734544:0:11614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1781685400/0xf7565228e460dd2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dd28 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117423.734552:0:11614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c178149d800/0xf7565228e460dd36 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117423.734596:0:11614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1781685400/0xf7565228e460dd2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460dd28 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117423.734623:0:11614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1781685400/0xf7565228e460dd2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460dd28 expref: 18 pid: 5835 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117423.734638:0:11614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1788842940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11614:1876025385469440:0@lo:104: 00000100:00100000:3.0:1789117423.734699:0:11614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117423.734754:0:11614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178149d600/0xf7565228e460dd21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460dd1a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117423.734762:0:11614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c178149d600/0xf7565228e460dd21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460dd1a expref: 18 pid: 5835 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117423.734770:0:11614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f643c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11614:1876025385469568:0@lo:104: 00000100:00100000:3.0:1789117423.734791:0:11614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117423.734812:0:11614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178149d000/0xf7565228e460dd13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460dd0c expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117423.734821:0:11614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c178149d000/0xf7565228e460dd13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460dd0c expref: 18 pid: 5835 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117423.734828:0:11614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f67840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11614:1876025385469696:0@lo:104: 00000100:00100000:3.0:1789117423.734850:0:11614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117423.734868:0:11614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1787cbde00/0xf7565228e460dd05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c736 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117423.734878:0:11614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1787cbde00/0xf7565228e460dd05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c736 expref: 12 pid: 5835 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117423.734890:0:11614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f652c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11614:1876025385469824:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117423.734961:0:11614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1787cbd800/0xf7565228e460dcfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c72f expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117423.734971:0:11614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1787cbd800/0xf7565228e460dcfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c72f expref: 12 pid: 5833 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117423.734981:0:11614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f67480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11614:1876025385469952:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117423.735007:0:11614:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785c04840 going to sleep for 11 seconds 00000100:00100000:1.0:1789117423.735151:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789117423.735167:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385469440 00000100:00100000:1.0:1789117423.735174:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385469440 00000100:00100000:1.0:1789117423.735212:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385469568 00000100:00100000:1.0:1789117423.735214:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385469568 00000100:00100000:1.0:1789117423.735225:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385469696 00000100:00100000:1.0:1789117423.735228:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385469696 00000100:00100000:1.0:1789117423.735245:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789117423.735253:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f65680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+5:11614:x1876025385469440:12345-0@lo:104: 00010000:00010000:1.0:1789117423.735278:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460dd28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dd2f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.735330:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789117423.735336:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f65680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+5:11614:x1876025385469440:12345-0@lo:104: Request processed in 84us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117423.735343:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789117423.735359:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789117423.735365:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f64b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+4:11614:x1876025385469568:12345-0@lo:104: 00010000:00010000:1.0:1789117423.735382:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c1781685200/0xf7565228e460dd1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dd21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.735442:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789117423.735447:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f64b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+4:11614:x1876025385469568:12345-0@lo:104: Request processed in 83us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117423.735454:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789117423.735467:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789117423.735473:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681489850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:11614:x1876025385469696:12345-0@lo:104: 00010000:00010000:1.0:1789117423.735481:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c178457f600/0xf7565228e460dd0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dd13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.735507:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789117423.735511:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681489850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:11614:x1876025385469696:12345-0@lo:104: Request processed in 40us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117423.735516:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1789117423.735555:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789117423.735560:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460dd28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dd2f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.735567:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178149c800 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:1.0:1789117423.735570:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460dd28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460dd2f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.735579:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460dd28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460dd2f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117423.735586:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460dd28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460dd2f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117423.735598:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789117423.735635:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460dd28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dd2f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.735641:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117423.735660:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460dd28 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dd2f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.735666:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178149c800/0xf7565228e460dd28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dd2f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.735680:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789117423.735682:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c1781685200/0xf7565228e460dd1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dd21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.735687:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685200 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:1.0:1789117423.735690:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c1781685200/0xf7565228e460dd1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460dd21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.735696:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c1781685200/0xf7565228e460dd1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460dd21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117423.735701:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c1781685200/0xf7565228e460dd1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460dd21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117423.735706:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789117423.735719:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c1781685200/0xf7565228e460dd1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dd21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.735732:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117423.735745:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c1781685200/0xf7565228e460dd1a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dd21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.735751:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c1781685200/0xf7565228e460dd1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dd21 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.735762:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117423.735765:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c178457f600/0xf7565228e460dd0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dd13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.735770:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f600 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:1.0:1789117423.735772:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c178457f600/0xf7565228e460dd0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460dd13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.735779:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178457f600/0xf7565228e460dd0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460dd13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117423.735784:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178457f600/0xf7565228e460dd0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460dd13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117423.735789:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789117423.735802:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c178457f600/0xf7565228e460dd0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dd13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.735808:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117423.735823:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c178457f600/0xf7565228e460dd0c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dd13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.735830:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178457f600/0xf7565228e460dd0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dd13 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.735841:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117423.735848:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117423.735850:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117423.735856:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117423.735869:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385470080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117423.735899:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117423.735921:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117423.735927:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385470208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117423.735949:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117423.735977:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385470336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117423.736001:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117423.736040:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385470080 00000100:00100000:1.0:1789117423.736045:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385470080 00010000:00010000:1.0:1789117423.736064:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1781685400/0xf7565228e460dd2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dd28 expref: 19 pid: 5835 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117423.736085:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385470208 00000100:00100000:1.0:1789117423.736087:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385470208 00010000:00010000:1.0:1789117423.736096:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178149d600/0xf7565228e460dd21 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dd1a expref: 20 pid: 5835 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117423.736105:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385470336 00000100:00100000:1.0:1789117423.736107:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385470336 00010000:00010000:1.0:1789117423.736115:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178149d000/0xf7565228e460dd13 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dd0c expref: 21 pid: 5835 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117423.736125:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789117423.736131:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d52580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+21:3298:x1876025385470080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117423.736140:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117423.736146:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1781685400/0xf7565228e460dd2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dd28 expref: 21 pid: 5835 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.736163:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1781685400/0xf7565228e460dd2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460dd28 expref: 21 pid: 5835 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.736177:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117423.736211:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d52580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+21:3298:x1876025385470080:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117423.736219:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789117423.736235:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789117423.736243:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d50b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+20:3298:x1876025385470208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117423.736252:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117423.736257:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178149d600/0xf7565228e460dd21 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dd1a expref: 20 pid: 5835 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.736280:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178149d600/0xf7565228e460dd21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460dd1a expref: 20 pid: 5835 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.736291:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117423.736317:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d50b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+20:3298:x1876025385470208:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117423.736322:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789117423.736333:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789117423.736339:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17845e3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385470336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117423.736346:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117423.736349:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178149d000/0xf7565228e460dd13 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dd0c expref: 19 pid: 5835 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.736358:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178149d000/0xf7565228e460dd13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460dd0c expref: 19 pid: 5835 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.736373:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117423.736419:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17845e3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385470336:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117423.736425:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789117423.736484:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385470336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117423.736505:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385470208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117423.736512:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385470080:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789117423.743150:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1781685400/0xf7565228e460dd2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460dd28 expref: 18 pid: 5835 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117423.743170:0:11614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1788842940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11614:1876025385469440:0@lo:104: 00010000:00010000:3.0:1789117423.743182:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178149d600/0xf7565228e460dd21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460dd1a expref: 17 pid: 5835 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117423.743192:0:11614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f643c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11614:1876025385469568:0@lo:104: 00010000:00010000:3.0:1789117423.743204:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178149d000/0xf7565228e460dd13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460dd0c expref: 16 pid: 5835 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117423.743213:0:11614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f67840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11614:1876025385469696:0@lo:104: 00000100:00100000:2.0:1789117423.753453:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117423.753483:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117423.753573:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362365952 00000100:00100000:1.0:1789117423.753582:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362365952 00010000:00010000:1.0:1789117423.753620:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1787cbde00/0xf7565228e460dd05 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c736 expref: 13 pid: 5835 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117423.753656:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362366080 00000100:00100000:1.0:1789117423.753660:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362366080 00010000:00010000:1.0:1789117423.753672:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1787cbd800/0xf7565228e460dcfe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c72f expref: 14 pid: 5833 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117423.753694:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 33 00000100:00100000:1.0:1789117423.753701:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8628780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+14:2351:x1876025362365952:12345-192.168.206.37@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789117423.753703:0:11614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f652c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11614:1876025385469824:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117423.753713:0:11614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f67480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11614:1876025385469952:192.168.206.37@tcp:104: 00010000:00010000:1.0:1789117423.753714:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117423.753719:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1787cbde00/0xf7565228e460dd05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c736 expref: 14 pid: 5835 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117423.753745:0:11614:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c178149d800/0xf7565228e460dd36 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.753749:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1787cbde00/0xf7565228e460dd05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c736 expref: 14 pid: 5835 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117423.753808:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 34 00000100:00100000:0.0:1789117423.753821:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b862ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+14:2351:x1876025362366080:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117423.753832:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117423.753840:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1787cbd800/0xf7565228e460dcfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c72f expref: 14 pid: 5833 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117423.760847:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1787cbd800/0xf7565228e460dcfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c72f expref: 14 pid: 5833 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117423.760876:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1787cbd800/0xf7565228e460dcfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c72f expref: 14 pid: 5833 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117423.760891:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117423.760970:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b862ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2351:x1876025362366080:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 7152us (7485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117423.760981:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 34 00010000:00010000:1.0:1789117423.763603:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1787cbde00/0xf7565228e460dd05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c736 expref: 12 pid: 5835 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.763626:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c178149d800/0xf7565228e460dd36 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.763635:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178149d800/0xf7565228e460dd36 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.763656:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178149d800/0xf7565228e460dd36 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.763664:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178149d800/0xf7565228e460dd36 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.763670:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c178149d800/0xf7565228e460dd36 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.763678:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c178149d800/0xf7565228e460dd36 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.763684:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178149d800 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:1.0:1789117423.763688:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c178149d800/0xf7565228e460dd36 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.763695:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c178149d800/0xf7565228e460dd36 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117423.766186:0:11614:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c178149d800/0xf7565228e460dd36 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117423.766224:0:11614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c178149d800/0xf7565228e460dd36 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.768866:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c178149d800/0xf7565228e460dd36 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.768905:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178149d800/0xf7565228e460dd36 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117423.768930:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117423.769097:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8628780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:2351:x1876025362365952:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 15390us (15649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117423.769108:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 33 00010000:00010000:3.0:1789117424.462085:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117425.304595:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117425.304639:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117425.304669:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117425.304857:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362366208 00000100:00100000:0.0:1789117425.304867:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362366208 00000100:00100000:0.0:1789117425.304916:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 243 00000100:00100000:0.0:1789117425.304926:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:2351:x1876025362366208:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117425.305000:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:2351:x1876025362366208:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 75us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117425.305008:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 243 00000100:00100000:1.0:1789117425.306232:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362366464 00000100:00100000:1.0:1789117425.306242:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362366464 00000100:00100000:1.0:1789117425.306310:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362366336 00000100:00080000:2.0:1789117425.306504:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117425.306714:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362366336 00000100:00100000:1.0:1789117425.306775:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 86 00000100:00100000:1.0:1789117425.306785:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b862a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362366464:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117425.306852:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b862a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362366464:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 69us (2212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117425.306860:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 86 00000100:00100000:1.0:1789117425.306878:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 87 00000100:00100000:1.0:1789117425.306884:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8629680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362366336:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117425.309656:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8629680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362366336:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 2768us (4981us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117425.309667:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 87 00000100:00080000:2.0:1789117425.310830:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:3.0:1789117425.477519:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789117425.477528:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c16816f2800 from 7 10000000:01000000:3.0:1789117425.477534:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789117425.477581:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149d000/0xf7565228e460dd3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117425.477593:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178149d000/0xf7565228e460dd3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117425.477602:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117425.477604:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178149d000/0xf7565228e460dd3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117425.477630:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385470464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789117425.477699:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117425.477766:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178c5be9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117425.477878:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385470464 00000100:00100000:0.0:1789117425.477886:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385470464 00000100:00100000:0.0:1789117425.477930:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789117425.477939:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:5837:x1876025385470464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117425.477952:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117425.477964:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1787cbd600/0xf7565228e460dd44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dd3d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117425.477986:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1787cbd600/0xf7565228e460dd44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dd3d expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117425.477996:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1787cbd600/0xf7565228e460dd44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dd3d expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117425.478004:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbd600, rc 0) 00000100:00100000:0.0:1789117425.478052:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385470464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117425.478059:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789117425.478162:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385470464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117425.478178:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178149d000/0xf7565228e460dd3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dd44 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117425.478186:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178149d000/0xf7565228e460dd3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dd44 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117425.478373:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385470592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117425.478422:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117425.478460:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178c5be9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117425.478514:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385470592 00000100:00100000:0.0:1789117425.478518:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385470592 00000100:00100000:0.0:1789117425.478546:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789117425.478553:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385470592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117425.478786:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385470592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117425.478793:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789117425.478913:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385470592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117425.478951:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d503c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385470720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117425.478996:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117425.479019:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17882bfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789117425.479084:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385470720 00000100:00100000:2.0:1789117425.479094:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385470720 00000100:00100000:2.0:1789117425.479127:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789117425.479135:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385470720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117425.479451:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385470720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 316us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117425.479458:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789117425.479582:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d503c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385470720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117425.480432:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b862b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:11676:1876025385470848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117425.480488:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117425.480529:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787303780 going to sleep for 11 seconds 00000100:00100000:3.0:1789117425.480648:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385470848 00000100:00100000:3.0:1789117425.480654:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385470848 00000100:00100000:3.0:1789117425.480705:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789117425.480714:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:11676:x1876025385470848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117425.480994:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:11676:x1876025385470848:12345-0@lo:502:llog_process_th.0 Request processed in 280us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117425.481001:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789117425.482959:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b862b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:11676:1876025385470848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789117425.483013:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117425.483027:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117425.483029:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789117425.483036:0:11676:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c16816f2800 00000020:00000080:0.0:1789117425.483039:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789117425.483223:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:11676:1876025385470976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117425.483304:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117425.483345:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17ad148d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789117425.483475:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385470976 00000100:00100000:1.0:1789117425.483481:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385470976 00000100:00100000:1.0:1789117425.483534:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789117425.483543:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:11676:x1876025385470976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117425.484048:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:11676:x1876025385470976:12345-0@lo:502:llog_process_th.0 Request processed in 503us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117425.484057:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789117425.488521:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:11676:1876025385470976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789117425.488564:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117425.488572:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117425.488575:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:0.0:1789117425.488580:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789117425.489030:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789117425.489050:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789117425.489061:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149d000/0xf7565228e460dd3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dd44 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117425.489072:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178149d000/0xf7565228e460dd3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dd44 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117425.489082:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789117425.489085:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c17c03a3800 from 7 10000000:01000000:1.0:1789117425.489087:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789117425.489119:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460dd4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117425.489127:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460dd4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117425.489136:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460dd4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117425.489165:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d503c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385471104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789117425.489238:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117425.489293:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17882bf480 going to sleep for 11 seconds 00000100:00100000:3.0:1789117425.489489:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385471104 00000100:00100000:3.0:1789117425.489497:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385471104 00000100:00100000:3.0:1789117425.489552:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789117425.489562:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385471104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117425.489574:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117425.489588:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178149d600/0xf7565228e460dd52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dd4b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117425.489611:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178149d600/0xf7565228e460dd52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dd4b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117425.489621:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178149d600/0xf7565228e460dd52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dd4b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117425.489629:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178149d600, rc 0) 00000100:00100000:3.0:1789117425.489667:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385471104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117425.489673:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789117425.489823:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d503c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385471104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117425.489836:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460dd4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dd52 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117425.489845:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460dd4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dd52 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117425.489892:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d503c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385471232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117425.489922:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117425.489952:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17882bf480 going to sleep for 11 seconds 00000100:00100000:3.0:1789117425.490000:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385471232 00000100:00100000:3.0:1789117425.490004:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385471232 00000100:00100000:3.0:1789117425.490037:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789117425.490054:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385471232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117425.490301:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385471232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117425.490308:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789117425.491466:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d503c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385471232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117425.491514:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d503c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385471360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117425.491567:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117425.491600:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17882bf480 going to sleep for 11 seconds 00000100:00100000:3.0:1789117425.491809:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385471360 00000100:00100000:3.0:1789117425.491815:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385471360 00000100:00100000:3.0:1789117425.491846:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789117425.491853:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385471360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117425.492012:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385471360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117425.492020:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789117425.494263:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d503c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385471360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117425.494905:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d503c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:11678:1876025385471488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117425.494977:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117425.495018:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17882bf240 going to sleep for 11 seconds 00000100:00100000:3.0:1789117425.495070:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385471488 00000100:00100000:3.0:1789117425.495076:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385471488 00000100:00100000:3.0:1789117425.495121:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789117425.495130:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:11678:x1876025385471488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117425.495380:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:11678:x1876025385471488:12345-0@lo:502:llog_process_th.0 Request processed in 249us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117425.495387:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789117425.495693:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d503c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:11678:1876025385471488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117425.495719:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117425.495733:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117425.495735:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789117425.495742:0:11678:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c17c03a3800 00000020:00000080:1.0:1789117425.495745:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789117425.495828:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d503c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:11678:1876025385471616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117425.495864:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117425.495893:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178bd629c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117425.495943:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385471616 00000100:00100000:0.0:1789117425.495948:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385471616 00000100:00100000:0.0:1789117425.495982:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789117425.495990:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:11678:x1876025385471616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117425.496124:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:11678:x1876025385471616:12345-0@lo:502:llog_process_th.0 Request processed in 134us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117425.496139:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789117425.496228:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d503c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:11678:1876025385471616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117425.496262:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117425.496266:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117425.496269:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:1.0:1789117425.496272:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789117425.496633:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789117425.496649:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789117425.496658:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460dd4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dd52 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117425.496668:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460dd4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dd52 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117425.496679:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789117425.496681:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c178548d000 from 7 10000000:01000000:0.0:1789117425.496684:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789117425.496712:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc400/0xf7565228e460dd59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117425.496719:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc400/0xf7565228e460dd59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117425.496728:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc400/0xf7565228e460dd59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117425.496742:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385471744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789117425.496776:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117425.496807:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17ad148cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117425.496997:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385471744 00000100:00100000:1.0:1789117425.497002:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385471744 00000100:00100000:1.0:1789117425.497038:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789117425.497046:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385471744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117425.497054:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117425.497066:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1781685400/0xf7565228e460dd60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dd59 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117425.497084:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1781685400/0xf7565228e460dd60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dd59 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117425.497094:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1781685400/0xf7565228e460dd60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dd59 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117425.497101:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685400, rc 0) 00000100:00100000:1.0:1789117425.497130:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385471744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117425.497145:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789117425.497225:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385471744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117425.497237:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc400/0xf7565228e460dd59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dd60 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117425.497260:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc400/0xf7565228e460dd59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dd60 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117425.497554:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385471872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117425.497582:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117425.497605:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17ad148cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117425.497645:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385471872 00000100:00100000:1.0:1789117425.497650:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385471872 00000100:00100000:1.0:1789117425.497690:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789117425.497698:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385471872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117425.497918:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385471872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117425.497925:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789117425.498038:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385471872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117425.498069:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385472000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117425.498107:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117425.498131:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17ad148cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117425.499266:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385472000 00000100:00100000:1.0:1789117425.499274:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385472000 00000100:00100000:1.0:1789117425.499324:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789117425.499333:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385472000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117425.499542:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385472000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 209us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117425.499549:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789117425.499648:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385472000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117425.500230:0:11679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c179305da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:11679:1876025385472128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117425.500305:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117425.500330:0:11679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17ad148cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117425.500439:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385472128 00000100:00100000:1.0:1789117425.500444:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385472128 00000100:00100000:1.0:1789117425.500475:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789117425.500483:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:11679:x1876025385472128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117425.500638:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:11679:x1876025385472128:12345-0@lo:502:llog_process_th.0 Request processed in 155us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117425.500644:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789117425.500907:0:11679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c179305da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:11679:1876025385472128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789117425.500935:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117425.500944:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117425.500946:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789117425.500953:0:11679:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c178548d000 00000020:00000080:3.0:1789117425.500955:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789117425.501036:0:11679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f67840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:11679:1876025385472256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117425.501075:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117425.501107:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385472256 00000100:00100000:3.0:1789117425.501110:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385472256 00000100:00100000:3.0:1789117425.501134:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789117425.501140:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:11679:x1876025385472256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117425.501349:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:11679:x1876025385472256:12345-0@lo:502:llog_process_th.0 Request processed in 207us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117425.501356:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789117425.501384:0:11679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178c5bed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789117425.501396:0:11679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f67840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:11679:1876025385472256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789117425.501436:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117425.501441:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117425.501443:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789117425.501447:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789117425.502128:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789117425.502149:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789117425.502158:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc400/0xf7565228e460dd59 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dd60 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117425.502180:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc400/0xf7565228e460dd59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dd60 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117425.625141:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117425.625424:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362366592 00000100:00100000:3.0:1789117425.625434:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362366592 00000100:00100000:3.0:1789117425.625490:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 259 00000100:00100000:3.0:1789117425.625499:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:5605:x1876025362366592:12345-192.168.206.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117425.625516:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117425.625531:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178149cc00/0xf7565228e460dd67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c73d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117425.625557:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178149cc00/0xf7565228e460dd67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c73d expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117425.625567:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178149cc00/0xf7565228e460dd67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c73d expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117425.625576:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178149cc00, rc 0) 00000100:00100000:3.0:1789117425.625698:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:5605:x1876025362366592:12345-192.168.206.37@tcp:101:ll_cfg_requeue.0 Request processed in 199us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117425.625705:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 259 00000100:00100000:2.0:1789117425.631368:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117425.631487:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362366720 00000100:00100000:1.0:1789117425.631497:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362366720 00000100:00100000:1.0:1789117425.631554:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 260 00000100:00100000:1.0:1789117425.631564:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:5605:x1876025362366720:12345-192.168.206.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117425.631845:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:5605:x1876025362366720:12345-192.168.206.37@tcp:501:ll_cfg_requeue.0 Request processed in 280us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117425.631853:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 260 00000100:00100000:2.0:1789117425.634339:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117425.634552:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362366848 00000100:00100000:0.0:1789117425.634561:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362366848 00000100:00100000:0.0:1789117425.634656:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 261 00000100:00100000:0.0:1789117425.634680:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:5605:x1876025362366848:12345-192.168.206.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117425.634894:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:5605:x1876025362366848:12345-192.168.206.37@tcp:503:ll_cfg_requeue.0 Request processed in 228us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117425.634902:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 261 00000100:00100000:2.0:1789117425.649615:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117425.649736:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362366976 00000100:00100000:3.0:1789117425.649746:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362366976 00000100:00100000:3.0:1789117425.649804:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 262 00000100:00100000:3.0:1789117425.649814:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:9532:x1876025362366976:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789117425.650169:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:9532:x1876025362366976:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 353us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117425.650177:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 262 00000100:00100000:2.0:1789117425.666817:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117425.673323:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362367104 00000100:00100000:0.0:1789117425.673337:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362367104 00000100:00100000:0.0:1789117425.673485:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 263 00000100:00100000:0.0:1789117425.673496:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:9532:x1876025362367104:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789117425.673753:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:9532:x1876025362367104:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 259us (6943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117425.673780:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 263 00000100:00100000:2.0:1789117425.692921:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117425.693688:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362367232 00000100:00100000:0.0:1789117425.693698:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362367232 00000100:00100000:0.0:1789117425.693748:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 264 00000100:00100000:0.0:1789117425.693770:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:5605:x1876025362367232:12345-192.168.206.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117425.693785:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117425.693803:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1787cbc800/0xf7565228e460dd6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c744 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117425.693830:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1787cbc800/0xf7565228e460dd6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c744 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117425.693841:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1787cbc800/0xf7565228e460dd6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c744 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117425.693850:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbc800, rc 0) 00000100:00100000:0.0:1789117425.693905:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:5605:x1876025362367232:12345-192.168.206.37@tcp:101:ll_cfg_requeue.0 Request processed in 148us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117425.693912:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 264 00000100:00100000:2.0:1789117425.709131:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117425.709275:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362367360 00000100:00100000:1.0:1789117425.709285:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362367360 00000100:00100000:1.0:1789117425.709339:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 265 00000100:00100000:1.0:1789117425.709350:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:5605:x1876025362367360:12345-192.168.206.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117425.709646:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:5605:x1876025362367360:12345-192.168.206.37@tcp:501:ll_cfg_requeue.0 Request processed in 297us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117425.709655:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 265 00000100:00100000:2.0:1789117425.714926:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117425.715101:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362367488 00000100:00100000:1.0:1789117425.715110:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362367488 00000100:00100000:1.0:1789117425.715156:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 266 00000100:00100000:1.0:1789117425.715166:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:5605:x1876025362367488:12345-192.168.206.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117425.715382:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:5605:x1876025362367488:12345-192.168.206.37@tcp:503:ll_cfg_requeue.0 Request processed in 216us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117425.715391:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 266 00000100:00100000:2.0:1789117425.731964:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117425.734702:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362367616 00000100:00100000:0.0:1789117425.734715:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362367616 00000100:00100000:1.0:1789117425.741841:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 267 00000100:00100000:1.0:1789117425.741855:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:9535:x1876025362367616:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789117425.742219:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:9535:x1876025362367616:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 365us (10261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117425.742228:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 267 00000100:00100000:2.0:1789117425.764721:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117425.764902:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362367744 00000100:00100000:3.0:1789117425.764911:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362367744 00000100:00100000:3.0:1789117425.764964:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 268 00000100:00100000:3.0:1789117425.764974:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:9535:x1876025362367744:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789117425.765214:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:9535:x1876025362367744:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 229us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117425.765222:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 268 00000100:00100000:1.0:1789117426.245581:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d50b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385472768:0@lo:400:kworker.0 00000100:00100000:1.0:1789117426.245643:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117426.245694:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789117426.245699:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385472384:0@lo:400:kworker.0 00000100:00100000:1.0:1789117426.245723:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117426.245741:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876025385472896:0@lo:400:kworker.0 00000100:00100000:1.0:1789117426.245774:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117426.245794:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876025385472512:0@lo:400:kworker.0 00000100:00100000:1.0:1789117426.245813:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117426.245825:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d50f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385473024:0@lo:400:kworker.0 00000100:00100000:1.0:1789117426.245841:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117426.245855:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117426.245860:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385472640:0@lo:400:kworker.0 00000100:00100000:1.0:1789117426.245877:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117426.245903:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385472768 00000100:00100000:1.0:1789117426.245909:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385472768 00000100:00100000:1.0:1789117426.245964:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385473024 00000100:00100000:1.0:1789117426.245967:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385473024 00000100:00100000:1.0:1789117426.245992:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789117426.246001:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385472768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117426.246057:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385472768:12345-0@lo:400:kworker.0 Request processed in 58us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117426.246066:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789117426.246081:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789117426.246087:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168149b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385473024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117426.246116:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168149b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385473024:12345-0@lo:400:kworker.0 Request processed in 29us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117426.246122:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789117426.246139:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385472384 00000100:00100000:1.0:1789117426.246142:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385472384 00000100:00100000:1.0:1789117426.246162:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789117426.246167:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385472384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117426.246195:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385472384:12345-0@lo:400:kworker.0 Request processed in 28us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117426.246200:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:1.0:1789117426.246225:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117426.246229:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789117426.246271:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c1d50f00 x1876025385473024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117426.246285:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d50f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385473024:0@lo:400:kworker.0 00000100:00100000:1.0:1789117426.246313:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385472384:0@lo:400:kworker.0 00010000:00080000:1.0:1789117426.246321:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c1d50b40 x1876025385472768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117426.246329:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d50b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385472768:0@lo:400:kworker.0 00000100:00100000:3.0:1789117426.246758:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385472896 00000100:00100000:3.0:1789117426.246763:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385472896 00000100:00100000:3.0:1789117426.246800:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385472512 00000100:00100000:3.0:1789117426.246803:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385472512 00000100:00100000:3.0:1789117426.246815:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385472640 00000100:00100000:3.0:1789117426.246817:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385472640 00000100:00100000:3.0:1789117426.246831:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789117426.246838:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876025385472896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117426.246882:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876025385472896:12345-0@lo:400:kworker.0 Request processed in 45us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117426.246899:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789117426.246913:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789117426.246919:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681498f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876025385472512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117426.246953:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681498f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876025385472512:12345-0@lo:400:kworker.0 Request processed in 35us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117426.246959:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789117426.246969:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789117426.246975:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385472640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117426.247003:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385472640:12345-0@lo:400:kworker.0 Request processed in 28us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117426.247008:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1789117426.247087:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117426.247108:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385472640:0@lo:400:kworker.0 00000100:00100000:3.0:1789117426.247118:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876025385472512:0@lo:400:kworker.0 00000100:00100000:3.0:1789117426.247145:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876025385472896:0@lo:400:kworker.0 00010000:00010000:3.0:1789117426.509638:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117426.758642:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117426.758668:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385473152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117426.758736:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117426.758809:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385473152 00000100:00100000:3.0:1789117426.758816:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385473152 00000100:00100000:3.0:1789117426.758864:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789117426.758873:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f67840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385473152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117426.758907:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117426.758961:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f67840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385473152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117426.758970:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1789117426.759009:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b7f643c0 x1876025385473152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117426.759027:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385473152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117426.759278:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789117426.759289:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385473280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117426.759321:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117426.759391:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385473280 00000100:00100000:1.0:1789117426.759396:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385473280 00000100:00100000:1.0:1789117426.759454:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789117426.759461:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179305da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385473280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117426.759480:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117426.759515:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179305da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385473280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117426.759521:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1789117426.759552:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c1d51a40 x1876025385473280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117426.759576:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385473280:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789117427.526917:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117428.549800:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789117429.069915:0:11817:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 05:03:46 (1789117426) === 00010000:00010000:3.0:1789117429.573616:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117430.424736:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117430.424788:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117430.424835:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117430.424867:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362368000 00000100:00100000:2.0:1789117430.424875:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362368000 00000100:00100000:2.0:1789117430.424926:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362368128 00000100:00100000:2.0:1789117430.424929:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362368128 00000100:00100000:2.0:1789117430.424951:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 91 00000100:00100000:2.0:1789117430.424960:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8628f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362368000:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117430.425043:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8628f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362368000:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 83us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117430.425050:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 91 00000100:00100000:2.0:1789117430.425068:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 92 00000100:00100000:2.0:1789117430.425074:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8629a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362368128:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117430.425097:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8629a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362368128:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 23us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117430.425104:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 92 00000100:00080000:2.0:1789117430.425119:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117430.425865:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362367872 00000100:00100000:1.0:1789117430.425872:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362367872 00000100:00100000:1.0:1789117430.425902:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 270 00000100:00100000:1.0:1789117430.425910:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2351:x1876025362367872:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117430.425955:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2351:x1876025362367872:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 46us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117430.425962:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 270 00000100:00100000:2.0:1789117430.509190:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117430.509307:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117430.509427:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362368384 00000100:00100000:0.0:1789117430.509437:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362368384 00000100:00100000:0.0:1789117430.509493:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 0 00000100:00100000:0.0:1789117430.509504:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e0c4e520-7af6-449d-969f-b46035974613+6:9895:x1876025362368384:12345-192.168.206.37@tcp:700:mkdir.0 00000100:00100000:0.0:1789117430.509597:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e0c4e520-7af6-449d-969f-b46035974613+6:9895:x1876025362368384:12345-192.168.206.37@tcp:700:mkdir.0 Request processed in 95us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117430.509605:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 0 00000100:00100000:3.0:1789117430.509623:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362368256 00000100:00100000:3.0:1789117430.509629:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362368256 00000100:00100000:3.0:1789117430.509675:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 14 00000100:00100000:3.0:1789117430.509684:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b862b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2349:x1876025362368256:12345-192.168.206.37@tcp:41:mkdir.0 00000004:00000024:3.0:1789117430.509715:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789117430.509804:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b862b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2349:x1876025362368256:12345-192.168.206.37@tcp:41:mkdir.0 Request processed in 121us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117430.509812:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 14 00000100:00100000:2.0:1789117430.511523:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117430.511615:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362368640 00000100:00100000:0.0:1789117430.511623:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362368640 00000100:00100000:0.0:1789117430.511730:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 15 00000100:00100000:0.0:1789117430.511741:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b862a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+6:9895:x1876025362368640:12345-192.168.206.37@tcp:36:mkdir.0 00010000:00010000:0.0:1789117430.511790:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117430.511860:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460dc17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6b8 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.511879:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1783e89900) 00010000:00010000:0.0:1789117430.511889:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117430.512203:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460dd75 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.512215:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460dd75 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.512240:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460dd75 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.512268:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460dd7c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.512274:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460dd7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.516630:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460dd7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117430.520150:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789117430.520169:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460dd75 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.520188:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460dd75 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.520196:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460dd75 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.520201:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbde00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117430.520206:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460dd75 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.520213:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460dd75 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.520250:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782c0e500) 00010000:00010000:2.0:1789117430.520253:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117430.520258:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460dd75 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.520264:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460dd75 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789117430.520282:0:5841:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000fd47da04 reply state 00000000426f91cf transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460dd7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117430.520290:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789117430.520433:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b862a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+7:9895:x1876025362368640:12345-192.168.206.37@tcp:36:mkdir.0 Request processed in 8656us (8880us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789117430.520444:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 15 00010000:00010000:2.0:1789117430.526859:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460dd7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.526876:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460dd7c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.526883:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460dd7c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.526889:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbda00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117430.526894:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460dd7c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.526901:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460dd7c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.526933:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c1782c0e700) 00010000:00010000:2.0:1789117430.526937:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117430.526942:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460dd7c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.526949:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460dd7c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117430.527957:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117430.528256:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362368768 00000100:00100000:0.0:1789117430.528266:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362368768 00000100:00100000:0.0:1789117430.528333:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 16 00000100:00100000:0.0:1789117430.528343:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b862b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+6:9896:x1876025362368768:12345-192.168.206.37@tcp:101:chmod.0 00010000:00010000:0.0:1789117430.528366:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117430.528388:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460dd83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c74b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.528480:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460dd8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.528503:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460dd8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.528514:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460dd8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117430.528572:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1789117430.528576:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789117430.528620:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460dd8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.528647:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460dd83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c74b expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.528664:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460dd8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c74b expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.528673:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782c0e100) 00010000:00010000:0.0:1789117430.528686:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789117430.528690:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbd000, rc 0) 00000100:00100000:0.0:1789117430.528746:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b862b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+7:9896:x1876025362368768:12345-192.168.206.37@tcp:101:chmod.0 Request processed in 404us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117430.528754:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 16 00000100:00100000:1.0:1789117430.531764:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117430.531925:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362369024 00000100:00100000:3.0:1789117430.531934:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362369024 00000100:00100000:3.0:1789117430.531993:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 17 00000100:00100000:3.0:1789117430.532003:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+7:9896:x1876025362369024:12345-192.168.206.37@tcp:36:chmod.0 00010000:00010000:3.0:1789117430.532067:0:7242:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117430.532095:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460dd8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c74b expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.532131:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782c0e100) 00010000:00010000:3.0:1789117430.532142:0:7242:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789117430.532167:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149d800/0xf7565228e460dd91 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.532179:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149d800/0xf7565228e460dd91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.532187:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149d800/0xf7565228e460dd91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789117430.532961:0:7242:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000005001c228 reply state 000000003675b4d5 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149d800/0xf7565228e460dd91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117430.532976:0:7242:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789117430.532992:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1789117430.533261:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+8:9896:x1876025362369024:12345-192.168.206.37@tcp:36:chmod.0 Request processed in 1256us (1502us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789117430.533270:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 17 00010000:00010000:2.0:1789117430.537208:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149d800/0xf7565228e460dd91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.537238:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149d800/0xf7565228e460dd91 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.537246:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149d800/0xf7565228e460dd91 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.537252:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178149d800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117430.537256:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149d800/0xf7565228e460dd91 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.537263:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149d800/0xf7565228e460dd91 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.539392:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782df4300) 00010000:00010000:2.0:1789117430.539414:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789117430.539424:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149d800/0xf7565228e460dd91 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.539434:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149d800/0xf7565228e460dd91 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117430.560079:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117430.560393:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362369152 00000100:00100000:3.0:1789117430.560445:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362369152 00000100:00100000:3.0:1789117430.560491:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 18 00000100:00100000:3.0:1789117430.560500:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+7:9897:x1876025362369152:12345-192.168.206.37@tcp:101:chown.0 00010000:00010000:3.0:1789117430.560522:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117430.560555:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149c800/0xf7565228e460dd98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c752 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.560619:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149d800/0xf7565228e460dd9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.560644:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149d800/0xf7565228e460dd9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.560656:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149d800/0xf7565228e460dd9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117430.560717:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1789117430.560720:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1789117430.560760:0:5839:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149d800/0xf7565228e460dd9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.560784:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149c800/0xf7565228e460dd98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c752 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.560801:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149d800/0xf7565228e460dd9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c752 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.560808:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782df4c00) 00010000:00010000:3.0:1789117430.560810:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789117430.560813:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178149d800, rc 0) 00000100:00100000:3.0:1789117430.560868:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+8:9897:x1876025362369152:12345-192.168.206.37@tcp:101:chown.0 Request processed in 370us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117430.560875:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 18 00000100:00100000:1.0:1789117430.568472:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117430.569060:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362369280 00000100:00100000:2.0:1789117430.569071:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362369280 00000100:00100000:2.0:1789117430.569133:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 19 00000100:00100000:2.0:1789117430.569143:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+8:9897:x1876025362369280:12345-192.168.206.37@tcp:101:chown.0 00010000:00010000:2.0:1789117430.569161:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117430.569181:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fc00/0xf7565228e460dda6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c759 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.569256:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ddad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.569269:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ddad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.569509:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ddad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.569639:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460ddb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.569651:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460ddb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.569659:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460ddb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.569756:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ddbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.569764:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ddbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.569770:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ddbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117430.569807:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1789117430.569810:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789117430.569838:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ddbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.569850:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ddad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.569856:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ddad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.569876:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ddad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.569882:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117430.569886:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ddad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.569893:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ddad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.569904:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782df4c00) 00010000:00010000:0.0:1789117430.569907:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117430.569912:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ddad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.569918:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ddad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.569932:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460ddb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.569937:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460ddb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.569942:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460ddb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.569947:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbcc00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117430.569949:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460ddb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.569965:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460ddb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.569972:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c1782c0ec00) 00010000:00010000:0.0:1789117430.569975:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117430.569978:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460ddb4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.569984:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460ddb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.570017:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fc00/0xf7565228e460dda6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c759 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.570030:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ddbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c759 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.570038:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c1782c0eb00) 00010000:00010000:0.0:1789117430.570040:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789117430.570043:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbca00, rc 0) 00000100:00100000:0.0:1789117430.570103:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+9:9897:x1876025362369280:12345-192.168.206.37@tcp:101:chown.0 Request processed in 962us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117430.570110:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 19 00000100:00100000:2.0:1789117430.580705:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117430.583870:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362369536 00000100:00100000:3.0:1789117430.583887:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362369536 00000100:00100000:3.0:1789117430.583962:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 20 00000100:00100000:3.0:1789117430.583974:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+9:9897:x1876025362369536:12345-192.168.206.37@tcp:36:chown.0 00010000:00010000:3.0:1789117430.584309:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117430.584448:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ddbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c759 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.584479:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c1782c0eb00) 00010000:00010000:3.0:1789117430.584490:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789117430.584516:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149c800/0xf7565228e460ddc2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.584528:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149c800/0xf7565228e460ddc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.584661:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149c800/0xf7565228e460ddc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.599126:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789117430.647490:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:2.0:1789117430.647508:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1789117430.647693:0:5839:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bd0ea75d reply state 00000000d2c823d0 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149c800/0xf7565228e460ddc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117430.647708:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789117430.647979:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1789117430.648111:0:5839:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789117430.648134:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+7:9897:x1876025362369536:12345-192.168.206.37@tcp:36:chown.0 Request processed in 64159us (67443us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789117430.648151:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 20 00010000:00010000:2.0:1789117430.648296:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149c800/0xf7565228e460ddc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.648305:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149c800/0xf7565228e460ddc2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.648312:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149c800/0xf7565228e460ddc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.648318:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178149c800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117430.648330:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149c800/0xf7565228e460ddc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.648338:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149c800/0xf7565228e460ddc2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.648351:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c1782df4400) 00010000:00010000:2.0:1789117430.648355:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789117430.648360:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149c800/0xf7565228e460ddc2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.648367:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149c800/0xf7565228e460ddc2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117430.668177:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117430.670604:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362369664 00000100:00100000:3.0:1789117430.670618:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362369664 00000100:00100000:3.0:1789117430.670684:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 21 00000100:00100000:3.0:1789117430.670694:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+6:9898:x1876025362369664:12345-192.168.206.37@tcp:101:touch.500 00010000:00010000:3.0:1789117430.670717:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117430.670736:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149c800/0xf7565228e460ddc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c760 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789117430.674147:0:7242:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3342us 00010000:00010000:0.0:1789117430.694748:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460ddd0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.694786:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460ddd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.694797:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460ddd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.694813:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460ddd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.694821:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460ddd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.694827:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460ddd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.695268:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd400/0xf7565228e460ddde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.695279:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd400/0xf7565228e460ddde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.695287:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd400/0xf7565228e460ddde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117430.695368:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789117430.695372:0:7242:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789117430.695495:0:7242:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd400/0xf7565228e460ddde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.695508:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460ddd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.695525:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460ddd0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.695531:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460ddd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.697639:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbcc00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117430.697648:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460ddd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.697660:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460ddd0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.697768:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782df4c00) 00010000:00010000:0.0:1789117430.697771:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117430.697776:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460ddd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.697782:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460ddd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.697796:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460ddd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.697802:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460ddd7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.697808:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460ddd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.697814:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbc600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117430.697828:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460ddd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.697835:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460ddd7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.697844:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c1782c0ec00) 00010000:00010000:0.0:1789117430.697846:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117430.697849:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460ddd7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.697855:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460ddd7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.697907:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149c800/0xf7565228e460ddc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c760 expref: 8 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.697925:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd400/0xf7565228e460ddde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c760 expref: 7 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.697933:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c1782c0ee00) 00010000:00010000:0.0:1789117430.697935:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789117430.697937:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbd400, rc 0) 00000100:00100000:0.0:1789117430.698009:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+7:9898:x1876025362369664:12345-192.168.206.37@tcp:101:touch.500 Request processed in 27315us (29843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117430.698018:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 21 00000100:00100000:1.0:1789117430.704744:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117430.704813:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362369920 00000100:00100000:0.0:1789117430.704823:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362369920 00000100:00100000:0.0:1789117430.704881:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 22 00000100:00100000:0.0:1789117430.704891:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+7:9898:x1876025362369920:12345-192.168.206.37@tcp:101:touch.500 00010000:00010000:0.0:1789117430.704922:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117430.704942:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460dde5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c767 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.705270:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ddec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.705286:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ddec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.705296:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ddec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.705310:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460ddf3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.705317:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460ddf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.705324:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460ddf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789117430.706277:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789117430.707879:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460ddfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.707898:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460ddfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.707910:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460ddfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.707964:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ddec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.707971:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ddec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.707978:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ddec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.707985:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117430.707989:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ddec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.707996:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ddec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.708006:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c1782c0ee00) 00010000:00010000:0.0:1789117430.708010:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117430.708015:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ddec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.708022:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ddec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789117430.708034:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000007b5fcf1a reply state 00000000f2ed811a transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460ddf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117430.708043:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789117430.708077:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460dde5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c767 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.708102:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460ddfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c767 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.708110:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:0.0:1789117430.708112:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117430.708115:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbde00, rc 0) 00000100:00100000:0.0:1789117430.708189:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+10:9898:x1876025362369920:12345-192.168.206.37@tcp:101:touch.500 Request processed in 3299us (3453us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789117430.708197:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 22 00000100:00100000:1.0:1789117430.711947:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117430.712056:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362370176 00000100:00100000:0.0:1789117430.712066:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362370176 00000100:00100000:0.0:1789117430.712120:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 23 00000100:00100000:0.0:1789117430.712131:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+10:9898:x1876025362370176:12345-192.168.206.37@tcp:36:touch.500 00010000:00010000:2.0:1789117430.712147:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460ddf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.712159:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460ddf3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.712166:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460ddf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.712172:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbda00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117430.712176:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460ddf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.712183:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460ddf3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.712184:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117430.712204:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xdfab7e5c (ffff9c1782c0e600) 00010000:00010000:0.0:1789117430.712211:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460ddfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c767 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.712234:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117430.712241:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460ddf3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.712242:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:2.0:1789117430.712253:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460ddf3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.712255:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117430.712309:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460de08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.712322:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460de08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.712331:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460de08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789117430.712523:0:5841:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000114649f8 reply state 0000000057041672 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460de08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117430.712532:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789117430.712605:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+10:9898:x1876025362370176:12345-192.168.206.37@tcp:36:touch.500 Request processed in 476us (665us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789117430.712612:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 23 00000100:00100000:2.0:1789117430.720187:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117430.720495:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362370304 00000100:00100000:3.0:1789117430.720504:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362370304 00000100:00100000:3.0:1789117430.720568:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 24 00000100:00100000:3.0:1789117430.720578:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+10:9898:x1876025362370304:12345-192.168.206.37@tcp:101:touch.500 00010000:00010000:3.0:1789117430.720600:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117430.720620:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149c800/0xf7565228e460de0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c76e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.720902:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149c800/0xf7565228e460de0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c76e expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.720918:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149c800/0xf7565228e460de0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c76e expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.720938:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:3.0:1789117430.720942:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789117430.720945:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178149c800, rc 0) 00000100:00100000:3.0:1789117430.721236:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+11:9898:x1876025362370304:12345-192.168.206.37@tcp:101:touch.500 Request processed in 648us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117430.721244:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 24 00010000:00010000:1.0:1789117430.723304:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460de08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117430.723340:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460de08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117430.723347:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460de08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117430.723353:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbc600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117430.723357:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460de08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117430.723365:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460de08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117430.723383:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:1.0:1789117430.723386:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117430.723390:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460de08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117430.723396:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460de08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117430.726912:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117430.727022:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362370432 00000100:00100000:2.0:1789117430.727032:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362370432 00000100:00100000:2.0:1789117430.727077:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 16 00000100:00100000:2.0:1789117430.727084:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1876025362370432:12345-192.168.206.37@tcp:8:touch.500 00010000:00080000:2.0:1789117430.727114:0:6687:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:2.0:1789117430.727142:0:6687:0:(genops.c:1385:class_connect()) connect: client e0c4e520-7af6-449d-969f-b46035974613, cookie 0xf7565228e460de16 00002000:00100000:2.0:1789117430.727152:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e0c4e520-7af6-449d-969f-b46035974613/ffff9c1787215000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789117430.727173:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789117430.727392:0:6687:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789117430.727456:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9c1787217000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789117430.727525:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+6:2348:x1876025362370432:12345-192.168.206.37@tcp:8:touch.500 Request processed in 440us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117430.728318:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 16 00000100:00100000:2.0:1789117430.729965:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117430.733474:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362370560 00000100:00100000:1.0:1789117430.733489:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362370560 00000100:00100000:0.0:1789117430.736850:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 17 00000100:00100000:0.0:1789117430.736866:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+6:0:x1876025362370560:12345-192.168.206.37@tcp:2:touch.500 00000100:00080000:2.0:1789117430.744100:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789117430.806018:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1789117430.806036:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e0c4e520-7af6-449d-969f-b46035974613 00000100:00100000:3.0:1789117430.806339:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+5:0:x1876025362370560:12345-192.168.206.37@tcp:2:touch.500 Request processed in 69471us (76375us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789117430.806351:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 17 00000100:00100000:3.0:1789117430.813698:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117430.813815:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362370816 00000100:00100000:1.0:1789117430.813823:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362370816 00000100:00100000:1.0:1789117430.813881:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 2 00000100:00100000:1.0:1789117430.813890:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+10:9898:x1876025362370816:12345-192.168.206.37@tcp:35:touch.500 00000100:00100000:1.0:1789117430.814219:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+11:9898:x1876025362370816:12345-192.168.206.37@tcp:35:touch.500 Request processed in 328us (529us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789117430.814236:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 2 00000100:00100000:1.0:1789117430.825514:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117430.829088:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362370944 00000100:00100000:3.0:1789117430.829119:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362370944 00000100:00100000:3.0:1789117430.829192:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 25 00000100:00100000:3.0:1789117430.829202:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+11:9899:x1876025362370944:12345-192.168.206.37@tcp:101:rm.0 00010000:00010000:3.0:1789117430.829235:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117430.829256:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460de1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c775 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.829322:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460de24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.829336:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460de24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.829349:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460de24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117430.829436:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789117430.829441:0:7242:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789117430.829483:0:7242:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460de24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.829510:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460de1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c775 expref: 13 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.829540:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460de24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c775 expref: 12 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.829550:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c1782c0ee00) 00010000:00010000:3.0:1789117430.829553:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789117430.829558:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781684c00, rc 0) 00000100:00100000:3.0:1789117430.829642:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+12:9899:x1876025362370944:12345-192.168.206.37@tcp:101:rm.0 Request processed in 441us (4138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117430.829650:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 25 00000100:00100000:2.0:1789117430.836678:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117430.836779:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362371200 00000100:00100000:0.0:1789117430.836790:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362371200 00000100:00100000:0.0:1789117430.836853:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 26 00000100:00100000:0.0:1789117430.836864:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+12:9899:x1876025362371200:12345-192.168.206.37@tcp:101:rm.0 00010000:00010000:0.0:1789117430.836884:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117430.836904:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460de2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c77c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117430.837025:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1789117430.837189:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460de2b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c77c expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.837203:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782df4c00) 00010000:00010000:0.0:1789117430.837206:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789117430.837212:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460de2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c77c expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.837246:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbde00, rc 0) 00000100:00100000:0.0:1789117430.837304:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+13:9899:x1876025362371200:12345-192.168.206.37@tcp:101:rm.0 Request processed in 442us (636us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1789117430.837312:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 26 00000100:00100000:2.0:1789117430.844567:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117430.845880:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362371328 00000100:00100000:0.0:1789117430.845894:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362371328 00000100:00100000:0.0:1789117430.845956:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 3 00000100:00100000:0.0:1789117430.845966:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168395a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+13:9899:x1876025362371328:12345-192.168.206.37@tcp:37:rm.0 00000100:00100000:0.0:1789117430.853382:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168395a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+13:9899:x1876025362371328:12345-192.168.206.37@tcp:37:rm.0 Request processed in 7408us (8816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117430.853395:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 3 00000100:00100000:2.0:1789117430.865702:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117430.865801:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362371584 00000100:00100000:1.0:1789117430.865810:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362371584 00000100:00100000:1.0:1789117430.865868:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 4 00000100:00100000:1.0:1789117430.865878:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a9737850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+13:9899:x1876025362371584:12345-192.168.206.37@tcp:35:rm.0 00000100:00100000:1.0:1789117430.866134:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a9737850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+14:9899:x1876025362371584:12345-192.168.206.37@tcp:35:rm.0 Request processed in 256us (442us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789117430.866142:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 4 00000100:00100000:2.0:1789117430.877913:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117430.878026:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362371840 00000100:00100000:3.0:1789117430.878036:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362371840 00000100:00100000:3.0:1789117430.878108:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 27 00000100:00100000:3.0:1789117430.878119:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168395a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+14:9899:x1876025362371840:12345-192.168.206.37@tcp:101:rm.0 00010000:00010000:3.0:1789117430.878141:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117430.878162:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460de39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c783 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.878292:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460de40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.878307:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460de40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.878320:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460de40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117430.878331:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1789117430.878492:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460de39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c783 expref: 17 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.878511:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460de40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c783 expref: 16 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.878519:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c1782c0ee00) 00010000:00010000:3.0:1789117430.878522:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789117430.878547:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685600, rc 0) 00000100:00100000:2.0:1789117430.878778:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168395a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+16:9899:x1876025362371840:12345-192.168.206.37@tcp:101:rm.0 Request processed in 659us (873us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789117430.878791:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 27 00000100:00100000:3.0:1789117430.881873:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117430.881966:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362371968 00000100:00100000:2.0:1789117430.881975:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362371968 00000100:00100000:2.0:1789117430.882040:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 28 00000100:00100000:2.0:1789117430.882050:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+16:9899:x1876025362371968:12345-192.168.206.37@tcp:41:rm.0 00000004:00000024:2.0:1789117430.882112:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1789117430.882182:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+16:9899:x1876025362371968:12345-192.168.206.37@tcp:41:rm.0 Request processed in 132us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117430.882190:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 28 00000100:00100000:1.0:1789117430.892955:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117430.893068:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362372096 00000100:00100000:0.0:1789117430.893088:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362372096 00000100:00100000:0.0:1789117430.893148:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 29 00000100:00100000:0.0:1789117430.893159:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+16:9899:x1876025362372096:12345-192.168.206.37@tcp:101:rm.0 00010000:00010000:0.0:1789117430.893180:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117430.893202:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460de4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c78a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.893276:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460de55 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.893292:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460de55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.893302:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460de55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.893333:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460de5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.893940:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460de5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.893950:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460de5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894179:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460de63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894189:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460de63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894197:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460de63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117430.894243:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789117430.894247:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789117430.894265:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460de63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894278:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460de63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894286:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460de55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894292:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460de55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894308:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460de55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894314:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbca00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117430.894319:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460de55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894327:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460de55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894340:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c1782c0ee00) 00010000:00010000:0.0:1789117430.894343:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117430.894348:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460de55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894356:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460de55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894370:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460de5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894377:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460de5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894383:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460de5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894389:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117430.894392:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460de5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894438:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460de5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894448:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xdfab7e5c (ffff9c1782c0ed00) 00010000:00010000:0.0:1789117430.894450:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117430.894454:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460de5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894461:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460de5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894498:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460de4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c78a expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894512:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460de63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c78a expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.894519:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:0.0:1789117430.894521:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117430.894524:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbcc00, rc 0) 00000100:00100000:0.0:1789117430.896248:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+17:9899:x1876025362372096:12345-192.168.206.37@tcp:101:rm.0 Request processed in 3082us (3293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117430.896260:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 29 00000100:00100000:2.0:1789117430.900900:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117430.901207:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362372352 00000100:00100000:0.0:1789117430.901216:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362372352 00000100:00100000:0.0:1789117430.901282:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 30 00000100:00100000:0.0:1789117430.901291:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1683958f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+17:9899:x1876025362372352:12345-192.168.206.37@tcp:36:rm.0 00010000:00010000:0.0:1789117430.901344:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789117430.901384:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460de63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c78a expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.901426:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149c800/0xf7565228e460de0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c76e expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.901438:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:0.0:1789117430.901451:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460de24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c775 expref: 15 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.901459:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c1782c0ee00) 00010000:00010000:0.0:1789117430.901462:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117430.901480:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460de6a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.901493:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460de6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.901503:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460de6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.901517:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460de71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.901523:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460de71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.901529:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460de71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.901648:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460de78 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.901663:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460de78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.901670:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460de78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789117430.902435:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789117430.902446:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 278032045403ns, next at 279032042948ns, rc = 0 00010000:00010000:0.0:1789117430.902504:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460de7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.902516:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460de7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.902524:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460de7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.902532:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460de7f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.902538:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460de7f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.902544:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460de7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.902568:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789117430.902587:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460de78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.902593:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460de78 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.902608:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460de78 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.902614:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbc200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117430.902617:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460de78 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.902625:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460de78 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.902635:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c1782c0eb00) 00010000:00010000:0.0:1789117430.902638:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789117430.902642:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460de78 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.902648:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460de78 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.902665:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460de6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.902671:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460de6a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.902677:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460de6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.902682:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbca00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117430.902684:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460de6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.902700:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460de6a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.902709:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c1782c0ee00) 00010000:00010000:0.0:1789117430.902712:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117430.902715:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460de6a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117430.902721:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460de6a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789117430.902731:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002a8d25af reply state 00000000aa204455 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460de71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117430.902740:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789117430.902812:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1683958f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+16:9899:x1876025362372352:12345-192.168.206.37@tcp:36:rm.0 Request processed in 1519us (1920us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789117430.902820:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 30 00010000:00010000:3.0:1789117430.907427:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117430.907441:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460de7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.907452:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbce00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117430.907456:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460de7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.907465:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460de7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.907481:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c1782c0eb00) 00010000:00010000:3.0:1789117430.907484:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789117430.907488:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460de7f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.907494:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460de7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117430.907518:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117430.907520:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117430.907522:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117430.908265:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460de71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.908277:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460de71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.908283:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460de71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.908289:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117430.908294:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460de71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.908301:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460de71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.908312:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xdfab7e5c (ffff9c1782c0e600) 00010000:00010000:2.0:1789117430.908315:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117430.908331:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460de71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.908336:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460de71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117430.912344:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117430.912450:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362372608 00000100:00100000:1.0:1789117430.912459:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362372608 00000100:00100000:1.0:1789117430.912511:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 5 00000100:00100000:1.0:1789117430.912520:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168395a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+15:9899:x1876025362372608:12345-192.168.206.37@tcp:35:rm.0 00000100:00100000:1.0:1789117430.912778:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168395a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+16:9899:x1876025362372608:12345-192.168.206.37@tcp:35:rm.0 Request processed in 259us (443us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789117430.912787:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 5 00000100:00100000:3.0:1789117430.916828:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117430.917819:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362372864 00000100:00100000:2.0:1789117430.917831:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362372864 00000100:00100000:2.0:1789117430.917907:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 31 00000100:00100000:2.0:1789117430.917918:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+16:9899:x1876025362372864:12345-192.168.206.37@tcp:36:rm.0 00010000:00010000:2.0:1789117430.917976:0:7242:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789117430.918004:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460de40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c783 expref: 16 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.918028:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd400/0xf7565228e460ddde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c760 expref: 15 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.918041:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c1782c0ee00) 00010000:00010000:2.0:1789117430.918057:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178149d800/0xf7565228e460dd9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c752 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.918067:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782df4c00) 00010000:00010000:2.0:1789117430.918074:0:7242:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117430.918097:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460de86 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.918110:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460de86 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.918138:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460de86 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.918151:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460de8d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.918158:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460de8d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.918164:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460de8d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.919529:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460de94 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.919543:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460de94 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.919553:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460de94 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117430.920181:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1789117430.920198:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460de94 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.920206:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460de94 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.920212:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460de94 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.920219:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117430.920240:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460de94 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.920249:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460de94 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.920261:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c1783e89a00) 00010000:00010000:2.0:1789117430.920263:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789117430.920267:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460de94 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.920273:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460de94 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.920294:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460de86 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.920300:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460de86 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.920306:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460de86 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.920311:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117430.920314:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460de86 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.920319:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460de86 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.920325:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1783e89300) 00010000:00010000:2.0:1789117430.920327:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117430.920337:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460de86 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117430.920342:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460de86 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789117430.920355:0:7242:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e4b7f5bf reply state 000000002af600e4 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460de8d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117430.920363:0:7242:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789117430.920488:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+15:9899:x1876025362372864:12345-192.168.206.37@tcp:36:rm.0 Request processed in 2568us (3668us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789117430.920498:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 31 00010000:00010000:1.0:1789117430.922884:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460de8d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117430.922899:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460de8d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117430.922907:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460de8d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117430.922931:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e400 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117430.922936:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460de8d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117430.922943:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460de8d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117430.922957:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c1783e89f00) 00010000:00010000:1.0:1789117430.923597:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117430.923604:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460de8d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117430.923612:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460de8d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117431.365981:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1683959e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876025385473536:0@lo:400:kworker.0 00000100:00100000:2.0:1789117431.365992:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168395a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385473664:0@lo:400:kworker.0 00000100:00100000:1.0:1789117431.366073:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168395b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385473408:0@lo:400:kworker.0 00000100:00100000:3.0:1789117431.366132:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385473792:0@lo:400:kworker.0 00000100:00100000:1.0:1789117431.366538:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117431.366542:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117431.366588:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876025385473920:0@lo:400:kworker.0 00000100:00100000:2.0:1789117431.369479:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117431.369503:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385474048:0@lo:400:kworker.0 00000100:00100000:1.0:1789117431.373019:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117431.373112:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385473408 00000100:00100000:1.0:1789117431.373121:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385473408 00000100:00100000:1.0:1789117431.373172:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789117431.373181:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3301:x1876025385473408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117431.373332:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3301:x1876025385473408:12345-0@lo:400:kworker.0 Request processed in 152us (6794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117431.373340:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789117431.373394:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168395b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385473408:0@lo:400:kworker.0 00000100:00100000:2.0:1789117431.373552:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117431.373673:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385474048 00000100:00100000:2.0:1789117431.373679:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385474048 00000100:00100000:2.0:1789117431.373805:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789117431.373815:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385474048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117431.375042:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385473664 00000100:00100000:1.0:1789117431.375052:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385473664 00000100:00100000:1.0:1789117431.375096:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385473920 00000100:00100000:1.0:1789117431.375099:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385473920 00000100:00100000:1.0:1789117431.375125:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789117431.375133:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385473664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117431.375334:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117431.375339:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385473664:12345-0@lo:400:kworker.0 Request processed in 204us (8792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117431.375348:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789117431.375368:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789117431.375377:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876025385473920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117431.375390:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385473792 00000100:00100000:3.0:1789117431.375396:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385473792 00000100:00100000:1.0:1789117431.375441:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876025385473920:12345-0@lo:400:kworker.0 Request processed in 65us (2429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117431.375447:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789117431.375452:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789117431.375460:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385473792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117431.375512:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385473792:12345-0@lo:400:kworker.0 Request processed in 55us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117431.375519:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789117431.375558:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c02ab480 x1876025385473792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117431.375560:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876025385473920:0@lo:400:kworker.0 00000100:00100000:3.0:1789117431.375572:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385473792:0@lo:400:kworker.0 00000100:00080000:3.0:1789117431.375625:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789117431.375630:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117431.375632:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117431.375670:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385474048:12345-0@lo:400:kworker.0 Request processed in 1855us (2115us total) trans 0 rc 0/0 00010000:00080000:3.0:1789117431.375675:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c02a9a40 x1876025385474048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117431.375683:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789117431.375694:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385474048:0@lo:400:kworker.0 00000100:00100000:3.0:1789117431.375706:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168395a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385473664:0@lo:400:kworker.0 00000100:00100000:0.0:1789117431.376245:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117431.376369:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385473536 00000100:00100000:1.0:1789117431.376375:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385473536 00000100:00100000:1.0:1789117431.376434:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789117431.376443:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179305ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876025385473536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117431.376516:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179305ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876025385473536:12345-0@lo:400:kworker.0 Request processed in 73us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117431.376523:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789117431.376528:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1683959e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876025385473536:0@lo:400:kworker.0 00010000:00010000:0.0:1789117431.621592:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117431.877739:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385474176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117431.877805:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117431.877943:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385474176 00000100:00100000:3.0:1789117431.877951:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385474176 00000100:00100000:3.0:1789117431.878003:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789117431.878013:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385474176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117431.878046:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117431.878091:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385474176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117431.878098:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1789117431.878190:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b7f64b40 x1876025385474176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117431.878209:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385474176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117431.879001:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385474304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117431.879045:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117431.880303:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385474304 00000100:00100000:3.0:1789117431.880313:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385474304 00000100:00100000:3.0:1789117431.880364:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789117431.880373:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385474304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117431.881300:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117431.881379:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385474304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1006us (2332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117431.881388:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789117431.881454:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b86b1a40 x1876025385474304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117431.881474:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385474304:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789117432.649580:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117433.669605:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789117434.462795:0:12015:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1789117434.693799:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789117435.354292:0:12063:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff21aec820 20000000:00000080:1.0:1789117435.354307:0:12063:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c17b7f75c00 uarg=0000000000000000 20000000:01000000:1.0:1789117435.354352:0:12063:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789117435.354359:0:12063:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789117435.354363:0:12063:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789117435.355760:0:12064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1789117435.356110:0:12063:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1789117435.362346:0:12063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10128 00000040:00080000:1.0:1789117435.362460:0:12063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10256 00000040:00080000:1.0:1789117435.362500:0:12063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10480 10000000:01000000:1.0:1789117435.362519:0:12063:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789117435.362538:0:12063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c178442ec00/0xf7565228e460de9b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.362555:0:12063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1787cbd600/0xf7565228e460dd44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dd3d expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.362562:0:12063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178149d600/0xf7565228e460dd52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dd4b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.362569:0:12063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1781685400/0xf7565228e460dd60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dd59 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.362578:0:12063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178149cc00/0xf7565228e460dd67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c73d expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.362585:0:12063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1787cbc800/0xf7565228e460dd6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c744 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.362592:0:12063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c178442ec00/0xf7565228e460de9b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.363036:0:12063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1787cbc800/0xf7565228e460dd6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c744 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.363050:0:12063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1787cbc800/0xf7565228e460dd6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c744 expref: 12 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117435.363064:0:12063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12063:1876025385474432:192.168.206.37@tcp:104: 00010000:00010000:1.0:1789117435.365069:0:12063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178149cc00/0xf7565228e460dd67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c73d expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.366681:0:12063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c178149cc00/0xf7565228e460dd67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c73d expref: 12 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117435.366712:0:12063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1683959e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12063:1876025385474560:192.168.206.37@tcp:104: 00010000:00010000:1.0:1789117435.366810:0:12063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1781685400/0xf7565228e460dd60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460dd59 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.366819:0:12063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1781685400/0xf7565228e460dd60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460dd59 expref: 18 pid: 5833 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117435.366826:0:12063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168395a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12063:1876025385474688:0@lo:104: 00000100:00100000:1.0:1789117435.366863:0:12063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789117435.368443:0:12063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178149d600/0xf7565228e460dd52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460dd4b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.368457:0:12063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c178149d600/0xf7565228e460dd52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460dd4b expref: 18 pid: 5835 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117435.368480:0:12063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01403c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12063:1876025385474816:0@lo:104: 00000100:00100000:2.0:1789117435.369025:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385474688 00000100:00100000:2.0:1789117435.369105:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385474688 00000100:00100000:2.0:1789117435.369227:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789117435.369237:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168395b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:12063:x1876025385474688:12345-0@lo:104: 00010000:00010000:2.0:1789117435.369257:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc400/0xf7565228e460dd59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dd60 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117435.369316:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789117435.369322:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168395b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:12063:x1876025385474688:12345-0@lo:104: Request processed in 88us (2459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117435.369329:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1789117435.369368:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117435.369374:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc400/0xf7565228e460dd59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dd60 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117435.369382:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbc400 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:0.0:1789117435.369387:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc400/0xf7565228e460dd59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460dd60 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117435.369395:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc400/0xf7565228e460dd59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460dd60 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117435.369415:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc400/0xf7565228e460dd59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460dd60 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117435.369421:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789117435.369449:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc400/0xf7565228e460dd59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dd60 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117435.369651:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117435.369672:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc400/0xf7565228e460dd59 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dd60 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117435.369679:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc400/0xf7565228e460dd59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dd60 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117435.369692:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117435.369694:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117435.369695:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117435.369708:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385474944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117435.369760:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117435.369801:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385474944 00000100:00100000:0.0:1789117435.369805:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385474944 00010000:00010000:0.0:1789117435.369824:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1781685400/0xf7565228e460dd60 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dd59 expref: 19 pid: 5833 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117435.369842:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789117435.369848:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3301:x1876025385474944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789117435.369857:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117435.369863:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1781685400/0xf7565228e460dd60 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dd59 expref: 19 pid: 5833 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117435.369873:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1781685400/0xf7565228e460dd60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460dd59 expref: 19 pid: 5833 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117435.369889:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117435.369916:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3301:x1876025385474944:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117435.369922:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789117435.369957:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385474944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117435.369981:0:12063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117435.370017:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385474816 00000100:00100000:2.0:1789117435.370022:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385474816 00000100:00100000:2.0:1789117435.370107:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789117435.370113:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0140b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:12063:x1876025385474816:12345-0@lo:104: 00010000:00010000:2.0:1789117435.370121:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460dd4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dd52 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117435.370159:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789117435.370164:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0140b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:12063:x1876025385474816:12345-0@lo:104: Request processed in 52us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117435.370170:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1789117435.370309:0:12063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1787cbd600/0xf7565228e460dd44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460dd3d expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117435.370319:0:12063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1787cbd600/0xf7565228e460dd44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460dd3d expref: 18 pid: 5835 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117435.370328:0:12063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b1e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12063:1876025385475072:0@lo:104: 00000100:00100000:0.0:1789117435.370350:0:12063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117435.370418:0:12063:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787303180 going to sleep for 11 seconds 00010000:00010000:0.0:1789117435.370434:0:12063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1781685400/0xf7565228e460dd60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460dd59 expref: 18 pid: 5833 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117435.370445:0:12063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168395a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12063:1876025385474688:0@lo:104: 00010000:00010000:1.0:1789117435.370502:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117435.370653:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460dd4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dd52 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.370662:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781684000 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:1.0:1789117435.370666:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460dd4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460dd52 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.370675:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460dd4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460dd52 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117435.370683:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460dd4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460dd52 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117435.370688:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789117435.370710:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460dd4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dd52 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.370716:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117435.370730:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460dd4b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dd52 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.370737:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c1781684000/0xf7565228e460dd4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dd52 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.370746:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117435.370748:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117435.370754:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117435.370770:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0140f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385475200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117435.370826:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385475072 00000100:00100000:2.0:1789117435.370831:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385475072 00000100:00100000:2.0:1789117435.370857:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789117435.370864:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:12063:x1876025385475072:12345-0@lo:104: 00010000:00010000:2.0:1789117435.370872:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c178149d000/0xf7565228e460dd3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dd44 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117435.370914:0:12063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01403c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12063:1876025385474816:0@lo:104: 00000100:00100000:3.0:1789117435.371034:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117435.371069:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362372992 00000100:00100000:3.0:1789117435.371073:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362372992 00000100:00100000:0.0:1789117435.371128:0:12063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12063:1876025385474432:192.168.206.37@tcp:104: 00000100:00100000:1.0:1789117435.371683:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117435.371737:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385475200 00000100:00100000:1.0:1789117435.371741:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385475200 00010000:00010000:1.0:1789117435.371761:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178149d600/0xf7565228e460dd52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dd4b expref: 18 pid: 5835 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117435.371791:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789117435.371799:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0142940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:3298:x1876025385475200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117435.371809:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117435.371815:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178149d600/0xf7565228e460dd52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dd4b expref: 18 pid: 5835 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.371824:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178149d600/0xf7565228e460dd52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460dd4b expref: 18 pid: 5835 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.371840:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178149d600/0xf7565228e460dd52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460dd4b expref: 18 pid: 5835 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.371852:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117435.371899:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789117435.371906:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0142940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:3298:x1876025385475200:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117435.371911:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+3:12063:x1876025385475072:12345-0@lo:104: Request processed in 1045us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117435.371919:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789117435.371935:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789117435.371954:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0140f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385475200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117435.371993:0:12063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b1e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12063:1876025385475072:0@lo:104: 00010000:00010000:0.0:1789117435.372006:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117435.372012:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c178149d000/0xf7565228e460dd3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460dd44 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117435.372019:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178149d000 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:0.0:1789117435.372022:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c178149d000/0xf7565228e460dd3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460dd44 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117435.372050:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1787cbc800/0xf7565228e460dd6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c744 expref: 13 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117435.372081:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 37 00000100:00100000:3.0:1789117435.372101:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f64b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2350:x1876025362372992:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117435.372110:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117435.372114:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1787cbc800/0xf7565228e460dd6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c744 expref: 13 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117435.372125:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1787cbc800/0xf7565228e460dd6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c744 expref: 13 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117435.372136:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1787cbc800/0xf7565228e460dd6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c744 expref: 13 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117435.372145:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117435.372212:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f64b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:2350:x1876025362372992:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 108us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117435.372220:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 37 00010000:00010000:0.0:1789117435.372922:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178149d000/0xf7565228e460dd3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460dd44 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117435.372931:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178149d000/0xf7565228e460dd3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460dd44 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117435.372937:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789117435.372976:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c178149d000/0xf7565228e460dd3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dd44 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117435.372982:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789117435.373023:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385475328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117435.373069:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117435.373165:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c178149d000/0xf7565228e460dd3d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dd44 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117435.373185:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178149d000/0xf7565228e460dd3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460dd44 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117435.373211:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117435.373213:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117435.373215:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117435.373226:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385475328 00000100:00100000:0.0:1789117435.373231:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385475328 00010000:00010000:0.0:1789117435.373249:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1787cbd600/0xf7565228e460dd44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dd3d expref: 17 pid: 5835 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117435.373268:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789117435.373274:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02aa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:3299:x1876025385475328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789117435.373282:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117435.373285:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1787cbd600/0xf7565228e460dd44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460dd3d expref: 17 pid: 5835 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117435.373295:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1787cbd600/0xf7565228e460dd44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460dd3d expref: 17 pid: 5835 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117435.373306:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1787cbd600/0xf7565228e460dd44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460dd3d expref: 17 pid: 5835 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117435.373314:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117435.373369:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02aa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:3299:x1876025385475328:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117435.373377:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789117435.373683:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385475328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789117435.381452:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117435.381554:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362373120 00000100:00100000:1.0:1789117435.381565:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362373120 00010000:00010000:1.0:1789117435.381615:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178149cc00/0xf7565228e460dd67 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c73d expref: 12 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117435.381669:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 39 00000100:00100000:1.0:1789117435.381678:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17845e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:2350:x1876025362373120:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117435.381693:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117435.381699:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178149cc00/0xf7565228e460dd67 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c73d expref: 12 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.381712:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178149cc00/0xf7565228e460dd67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c73d expref: 12 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.381734:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c178442ec00/0xf7565228e460de9b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 12063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.381742:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178442ec00/0xf7565228e460de9b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 12063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.381756:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178442ec00/0xf7565228e460de9b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.381777:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178442ec00/0xf7565228e460de9b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.381783:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c178442ec00/0xf7565228e460de9b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.381789:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c178442ec00/0xf7565228e460de9b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.381794:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ec00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:1.0:1789117435.381798:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c178442ec00/0xf7565228e460de9b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.381812:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c178442ec00/0xf7565228e460de9b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.381831:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c178442ec00/0xf7565228e460de9b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117435.381842:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117435.381904:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17845e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:2350:x1876025362373120:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 226us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117435.381912:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 39 00010000:00010000:0.0:1789117435.383149:0:12063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178149cc00/0xf7565228e460dd67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c73d expref: 11 pid: 5834 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117435.383185:0:12063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1683959e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12063:1876025385474560:192.168.206.37@tcp:104: 00010000:00010000:0.0:1789117435.383231:0:12063:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c178442ec00/0xf7565228e460de9b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117435.383240:0:12063:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c178442ec00/0xf7565228e460de9b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117435.383246:0:12063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c178442ec00/0xf7565228e460de9b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117435.383253:0:12063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178442ec00/0xf7565228e460de9b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117435.549229:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117435.549269:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117435.549326:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117435.549378:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362373376 00000100:00100000:3.0:1789117435.549387:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362373376 00000100:00100000:3.0:1789117435.549468:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 54 00000100:00100000:3.0:1789117435.549478:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+5:2349:x1876025362373376:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117435.549542:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+5:2349:x1876025362373376:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 66us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117435.549549:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 54 00000100:00080000:3.0:1789117435.549573:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117435.550617:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362373248 00000100:00100000:0.0:1789117435.550627:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362373248 00000100:00100000:0.0:1789117435.550688:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362373504 00000100:00100000:0.0:1789117435.550691:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362373504 00000100:00100000:0.0:1789117435.550722:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 96 00000100:00100000:0.0:1789117435.550730:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+14:2349:x1876025362373248:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117435.550787:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+14:2349:x1876025362373248:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 57us (1516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117435.550794:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 96 00000100:00100000:0.0:1789117435.550809:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 97 00000100:00100000:0.0:1789117435.550815:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2349:x1876025362373504:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117435.550843:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2349:x1876025362373504:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 27us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117435.550865:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 97 00000100:00080000:3.0:1789117435.550945:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789117435.719375:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789117436.049204:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:0.0:1789117436.049216:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789117436.049253:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:0.0:1789117436.049262:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1789117436.049576:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385475456:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789117436.049647:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117436.049869:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385475456 00000100:00100000:3.0:1789117436.049877:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385475456 00000100:00100000:3.0:1789117436.050613:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789117436.050624:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385475456:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789117436.050652:0:6687:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1789117436.050685:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa3c3f5, atime: 0x6aa3c3f5, ctime: 0x6aa3c3f5, blocks: 0x1 00010000:00010000:3.0:1789117436.050693:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5f15293/0xf7565228e460dea2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117436.050708:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=283s v=(0 0) 00010000:00010000:3.0:1789117436.050712:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117436.050719:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5f15293/0xf7565228e460dea2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117436.050753:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5f15293/0xf7565228e460dea2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117436.050763:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5f15293/0xf7565228e460dea2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117436.050771:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5f15293/0xf7565228e460dea2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117436.050793:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789117436.051431:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1876025385475456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 778us (1752us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789117436.051440:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1789117436.051708:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117436.051715:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5f15293/0xf7565228e460dea2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117436.051725:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2045600 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:0.0:1789117436.051729:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5f15293/0xf7565228e460dea2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117436.051739:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5f15293/0xf7565228e460dea2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117436.051758:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5f15293/0xf7565228e460dea2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117436.051765:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5f15293/0xf7565228e460dea2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117436.051786:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117436.051789:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117436.051798:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789117436.051836:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c17b7f652c0/2, rc 0, transno 4294967300 00000100:00100000:0.0:1789117436.051843:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385475456:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1789117436.054762:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117436.440558:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117436.440647:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362373632 00000100:00100000:2.0:1789117436.440655:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362373632 00000100:00100000:2.0:1789117436.440711:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 272 00000100:00100000:2.0:1789117436.440721:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:5605:x1876025362373632:12345-192.168.206.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117436.440748:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117436.440767:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178457fc00/0xf7565228e460dea9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c791 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117436.440792:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178457fc00/0xf7565228e460dea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c791 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117436.440802:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178457fc00/0xf7565228e460dea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c791 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117436.440811:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457fc00, rc 0) 00000100:00100000:2.0:1789117436.440878:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:5605:x1876025362373632:12345-192.168.206.37@tcp:101:ll_cfg_requeue.0 Request processed in 158us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117436.440885:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 272 00000100:00100000:3.0:1789117436.451789:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117436.451964:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362373760 00000100:00100000:1.0:1789117436.451973:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362373760 00000100:00100000:1.0:1789117436.452027:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 273 00000100:00100000:1.0:1789117436.452041:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:5605:x1876025362373760:12345-192.168.206.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117436.452331:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:5605:x1876025362373760:12345-192.168.206.37@tcp:501:ll_cfg_requeue.0 Request processed in 294us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117436.452339:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 273 00000100:00100000:3.0:1789117436.457296:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117436.459578:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362373888 00000100:00100000:1.0:1789117436.459591:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362373888 00000100:00100000:1.0:1789117436.460635:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 274 00000100:00100000:1.0:1789117436.460654:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:5605:x1876025362373888:12345-192.168.206.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789117436.460922:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:5605:x1876025362373888:12345-192.168.206.37@tcp:503:ll_cfg_requeue.0 Request processed in 274us (3633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117436.460931:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 274 00000100:00100000:0.0:1789117436.465648:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117436.466578:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362374016 00000100:00100000:2.0:1789117436.466590:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362374016 00000100:00100000:2.0:1789117436.466655:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 275 00000100:00100000:2.0:1789117436.466665:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:10169:x1876025362374016:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789117436.467189:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:10169:x1876025362374016:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 523us (1548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117436.467207:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 275 00000100:00100000:3.0:1789117436.474522:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117436.477725:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362374144 00000100:00100000:1.0:1789117436.477754:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362374144 00000100:00100000:1.0:1789117436.477836:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 276 00000100:00100000:1.0:1789117436.477853:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:10169:x1876025362374144:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789117436.478091:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:10169:x1876025362374144:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 246us (3586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117436.478099:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 276 00000100:00100000:2.0:1789117436.485648:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385475840:0@lo:400:kworker.0 00000100:00100000:0.0:1789117436.485660:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876025385475712:0@lo:400:kworker.0 00000100:00100000:1.0:1789117436.485816:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385475584:0@lo:400:kworker.0 00000100:00100000:3.0:1789117436.485871:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876025385475968:0@lo:400:kworker.0 00000100:00100000:0.0:1789117436.486676:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117436.486749:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385475712 00000100:00100000:0.0:1789117436.486756:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385475712 00000100:00100000:0.0:1789117436.486798:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789117436.486807:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876025385475712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117436.486860:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876025385475712:12345-0@lo:400:kworker.0 Request processed in 54us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117436.486868:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789117436.487509:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117436.487561:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385475840 00000100:00100000:2.0:1789117436.487566:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385475840 00000100:00100000:2.0:1789117436.487606:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789117436.487617:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385475840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117436.487660:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385475840:12345-0@lo:400:kworker.0 Request processed in 46us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117436.487667:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1789117436.487690:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117436.487718:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385475840:0@lo:400:kworker.0 00000100:00100000:0.0:1789117436.487797:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876025385475712:0@lo:400:kworker.0 00000100:00100000:3.0:1789117436.488102:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117436.488121:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117436.488162:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385476096:0@lo:400:kworker.0 00000100:00100000:1.0:1789117436.488208:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117436.488220:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385475968 00000100:00100000:0.0:1789117436.488226:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385475968 00000100:00100000:0.0:1789117436.488270:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1789117436.488272:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117436.488281:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876025385475968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117436.488807:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117436.488839:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385475584 00000100:00100000:2.0:1789117436.488844:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385475584 00000100:00100000:2.0:1789117436.488868:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362374272 00000100:00100000:2.0:1789117436.488871:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362374272 00000100:00100000:2.0:1789117436.488884:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789117436.488890:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:3301:x1876025385475584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117436.488932:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:3301:x1876025385475584:12345-0@lo:400:kworker.0 Request processed in 42us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117436.488953:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789117436.489177:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385476096 00000100:00100000:3.0:1789117436.489182:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385476096 00000100:00100000:3.0:1789117436.489237:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789117436.489245:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0142940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385476096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117436.489280:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0142940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385476096:12345-0@lo:400:kworker.0 Request processed in 37us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117436.489286:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789117436.489388:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 278 00000100:00100000:1.0:1789117436.489421:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:5605:x1876025362374272:12345-192.168.206.37@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789117436.489427:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876025385475968:12345-0@lo:400:kworker.0 Request processed in 1145us (1321us total) trans 0 rc 0/0 00010000:00010000:1.0:1789117436.489435:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1789117436.489437:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00010000:1.0:1789117436.489453:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178442f600/0xf7565228e460deb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c798 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117436.489478:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178442f600/0xf7565228e460deb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c798 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117436.489489:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178442f600/0xf7565228e460deb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c798 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117436.489499:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442f600, rc 0) 00000100:00100000:0.0:1789117436.489601:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876025385475968:0@lo:400:kworker.0 00000100:00100000:1.0:1789117436.489681:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:5605:x1876025362374272:12345-192.168.206.37@tcp:101:ll_cfg_requeue.0 Request processed in 283us (874us total) trans 0 rc 0/0 00000100:00080000:3.0:1789117436.489697:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789117436.489699:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 278 00000100:00100000:2.0:1789117436.490923:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385475584:0@lo:400:kworker.0 00010000:00080000:2.0:1789117436.490941:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b86b0780 x1876025385476096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117436.490951:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385476096:0@lo:400:kworker.0 00000100:00100000:0.0:1789117436.491662:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117436.491956:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362374400 00000100:00100000:2.0:1789117436.491972:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362374400 00000100:00100000:2.0:1789117436.492021:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 279 00000100:00100000:2.0:1789117436.492030:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:5605:x1876025362374400:12345-192.168.206.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117436.492331:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:5605:x1876025362374400:12345-192.168.206.37@tcp:501:ll_cfg_requeue.0 Request processed in 300us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117436.492339:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 279 00000100:00100000:0.0:1789117436.497178:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117436.497277:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362374528 00000100:00100000:1.0:1789117436.497286:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362374528 00000100:00100000:1.0:1789117436.497335:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 280 00000100:00100000:1.0:1789117436.497344:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:5605:x1876025362374528:12345-192.168.206.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117436.498454:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:5605:x1876025362374528:12345-192.168.206.37@tcp:503:ll_cfg_requeue.0 Request processed in 1106us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117436.498473:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 280 00000100:00100000:3.0:1789117436.504836:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117436.505097:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362374656 00000100:00100000:0.0:1789117436.505106:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362374656 00000100:00100000:0.0:1789117436.505166:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 281 00000100:00100000:0.0:1789117436.505176:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:10172:x1876025362374656:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789117436.505917:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:10172:x1876025362374656:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 740us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117436.505926:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 281 00000100:00100000:3.0:1789117436.509332:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117436.509473:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362374784 00000100:00100000:0.0:1789117436.509483:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362374784 00000100:00100000:0.0:1789117436.509652:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 282 00000100:00100000:0.0:1789117436.509663:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:10172:x1876025362374784:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789117436.509885:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:10172:x1876025362374784:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 223us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117436.509893:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 282 00010000:00010000:1.0:1789117436.743025:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789117436.997588:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789117436.997596:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c16816f2800 from 10 10000000:01000000:2.0:1789117436.997602:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789117436.997645:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460deb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117436.997656:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460deb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117436.997666:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460deb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117436.997690:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02a9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385476224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789117436.997754:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117436.997823:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17872d7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117436.998002:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385476352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117436.998035:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117436.998173:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385476224 00000100:00100000:0.0:1789117436.998181:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385476224 00000100:00100000:0.0:1789117436.998242:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789117436.998254:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:5837:x1876025385476224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117436.998267:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1789117436.998271:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117436.998281:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0142d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385476480:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789117436.998283:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1787cbd400/0xf7565228e460debe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460deb7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117436.998310:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1787cbd400/0xf7565228e460debe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460deb7 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117436.998314:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117436.998338:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1787cbd400/0xf7565228e460debe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460deb7 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117436.998348:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbd400, rc 0) 00000100:00100000:0.0:1789117436.998415:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385476224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117436.998423:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789117436.998619:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02a9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385476224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117436.998634:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460deb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460debe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117436.998643:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460deb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460debe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117436.998692:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02a9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385476608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117436.998717:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117436.998748:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17872d7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117436.999076:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385476608 00000100:00100000:0.0:1789117436.999081:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385476608 00000100:00100000:0.0:1789117436.999114:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789117436.999122:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385476608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117436.999354:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385476608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117436.999361:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789117437.002037:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02a9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385476608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117437.002102:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02a9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385476736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117437.002175:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117437.002301:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385476736 00000100:00100000:0.0:1789117437.002308:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385476736 00000100:00100000:0.0:1789117437.002351:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789117437.002360:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385476736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117437.002556:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385476736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117437.002565:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789117437.002690:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17872d7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117437.002705:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02a9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385476736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117437.003330:0:12077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02a9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:12077:1876025385476864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117437.003375:0:12077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117437.003421:0:12077:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17872d7480 going to sleep for 11 seconds 00000100:00100000:0.0:1789117437.003483:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385476864 00000100:00100000:0.0:1789117437.003488:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385476864 00000100:00100000:0.0:1789117437.003558:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789117437.003566:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:12077:x1876025385476864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117437.003719:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:12077:x1876025385476864:12345-0@lo:502:llog_process_th.0 Request processed in 153us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117437.003732:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789117437.004115:0:12077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02a9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:12077:1876025385476864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789117437.004140:0:12077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117437.004149:0:12077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117437.004151:0:12077:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789117437.004157:0:12077:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c16816f2800 00000020:00000080:2.0:1789117437.004160:0:12077:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789117437.004240:0:12077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02a9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:12077:1876025385476992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117437.004283:0:12077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117437.004306:0:12077:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17872d7480 going to sleep for 11 seconds 00000100:00100000:3.0:1789117437.004657:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385476352 00000100:00100000:3.0:1789117437.004664:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385476352 00000100:00100000:3.0:1789117437.004697:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385476480 00000100:00100000:3.0:1789117437.004700:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385476480 00000100:00100000:3.0:1789117437.004717:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789117437.004727:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0140f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385476352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117437.004833:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117437.004885:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0140f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385476352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (6848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117437.004893:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789117437.004914:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789117437.004922:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0140780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876025385476480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117437.004943:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117437.004973:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0140780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876025385476480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (6661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117437.004979:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789117437.005168:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385476992 00000100:00100000:3.0:1789117437.005173:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385476992 00000100:00100000:3.0:1789117437.005213:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789117437.005220:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:12077:x1876025385476992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117437.005568:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:12077:x1876025385476992:12345-0@lo:502:llog_process_th.0 Request processed in 348us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117437.005576:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789117437.005637:0:12077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02a9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:12077:1876025385476992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789117437.005671:0:12077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117437.005678:0:12077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117437.005680:0:12077:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789117437.005683:0:12077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000100:00100000:3.0:1789117437.005935:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0142d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385476480:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789117437.005952:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b7f64b40 x1876025385476352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117437.005966:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385476352:0@lo:13:osp-pre-1-0.0 00000020:01000000:3.0:1789117437.006006:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:3.0:1789117437.006097:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117437.006108:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460deb7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460debe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117437.006116:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460deb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460debe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117437.006125:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789117437.006127:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c17c03a3800 from 10 10000000:01000000:3.0:1789117437.006129:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789117437.006158:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460dec5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117437.006166:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460dec5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117437.006174:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460dec5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117437.006201:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385477120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789117437.006244:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117437.006271:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787c05c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117437.006284:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385477120 00000100:00100000:3.0:1789117437.006289:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385477120 00000100:00100000:3.0:1789117437.006317:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789117437.006324:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:5837:x1876025385477120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117437.006390:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117437.006431:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c17c2045800/0xf7565228e460decc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460dec5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117437.006452:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c17c2045800/0xf7565228e460decc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460dec5 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117437.006462:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c17c2045800/0xf7565228e460decc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460dec5 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117437.006470:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c17c2045800, rc 0) 00000100:00100000:3.0:1789117437.006502:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385477120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117437.006508:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789117437.006543:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385477120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117437.006556:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460dec5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460decc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117437.006564:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460dec5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460decc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117437.006613:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385477248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117437.006647:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117437.006668:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787c05c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117437.006679:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385477248 00000100:00100000:3.0:1789117437.006682:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385477248 00000100:00100000:3.0:1789117437.006699:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789117437.006705:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385477248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117437.007227:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385477248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 519us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117437.007234:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789117437.007265:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385477248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117437.007294:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385477376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117437.007330:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117437.007358:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787c05c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117437.007371:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385477376 00000100:00100000:3.0:1789117437.007375:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385477376 00000100:00100000:3.0:1789117437.007393:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789117437.007425:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385477376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117437.007553:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385477376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117437.007560:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789117437.007595:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385477376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117437.007996:0:12079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:12079:1876025385477504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117437.008101:0:12079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117437.008124:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385477504 00000100:00100000:3.0:1789117437.008134:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385477504 00000100:00100000:3.0:1789117437.008156:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789117437.008163:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:12079:x1876025385477504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117437.008303:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:12079:x1876025385477504:12345-0@lo:502:llog_process_th.0 Request processed in 140us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117437.008310:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789117437.008500:0:12079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1787c05cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117437.008515:0:12079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:12079:1876025385477504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789117437.008535:0:12079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117437.008544:0:12079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117437.008546:0:12079:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789117437.008552:0:12079:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c17c03a3800 00000020:00000080:3.0:1789117437.008554:0:12079:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789117437.008632:0:12079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:12079:1876025385477632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117437.008664:0:12079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117437.008682:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385477632 00000100:00100000:3.0:1789117437.008685:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385477632 00000100:00100000:3.0:1789117437.008705:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789117437.008712:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:12079:x1876025385477632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117437.008917:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:12079:x1876025385477632:12345-0@lo:502:llog_process_th.0 Request processed in 205us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117437.008924:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789117437.008957:0:12079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a0318240 going to sleep for 11 seconds 00000100:00100000:3.0:1789117437.009120:0:12079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:12079:1876025385477632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789117437.009136:0:12079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117437.009140:0:12079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117437.009145:0:12079:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789117437.009148:0:12079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789117437.009203:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:3.0:1789117437.009220:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117437.009228:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460dec5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460decc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117437.009236:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460dec5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460decc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117437.009244:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789117437.009246:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c178548d000 from 10 10000000:01000000:3.0:1789117437.009248:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789117437.009266:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2044800/0xf7565228e460ded3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117437.009273:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c17c2044800/0xf7565228e460ded3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117437.009279:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c17c2044800/0xf7565228e460ded3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117437.009289:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385477760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789117437.009310:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117437.009321:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a0318240 going to sleep for 11 seconds 00000100:00100000:3.0:1789117437.009331:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385477760 00000100:00100000:3.0:1789117437.009334:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385477760 00000100:00100000:3.0:1789117437.009351:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789117437.009357:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:5837:x1876025385477760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117437.009364:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117437.009378:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c17c2044c00/0xf7565228e460deda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460ded3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117437.009396:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c17c2044c00/0xf7565228e460deda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460ded3 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117437.009434:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c17c2044c00/0xf7565228e460deda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460ded3 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117437.009441:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c17c2044c00, rc 0) 00000100:00100000:3.0:1789117437.009464:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385477760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117437.009469:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789117437.009500:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385477760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117437.009509:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c17c2044800/0xf7565228e460ded3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460deda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117437.009516:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c17c2044800/0xf7565228e460ded3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460deda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117437.009546:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385477888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117437.009564:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117437.009578:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a0318240 going to sleep for 11 seconds 00000100:00100000:3.0:1789117437.009586:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385477888 00000100:00100000:3.0:1789117437.009588:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385477888 00000100:00100000:3.0:1789117437.009602:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789117437.009606:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385477888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117437.009980:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385477888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 371us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117437.010621:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789117437.010668:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385477888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117437.010703:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385478016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117437.010746:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117437.010852:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a0318240 going to sleep for 11 seconds 00000100:00100000:0.0:1789117437.011019:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385478016 00000100:00100000:0.0:1789117437.011025:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385478016 00000100:00100000:0.0:1789117437.011066:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1789117437.011074:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385478016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117437.011242:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:5837:x1876025385478016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117437.011249:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1789117437.011270:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:5837:1876025385478016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117437.011690:0:12080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:12080:1876025385478144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117437.011734:0:12080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117437.011956:0:12080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788234d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789117437.012113:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385478144 00000100:00100000:3.0:1789117437.012118:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385478144 00000100:00100000:3.0:1789117437.012200:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1789117437.012209:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:12080:x1876025385478144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117437.012432:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:12080:x1876025385478144:12345-0@lo:502:llog_process_th.0 Request processed in 225us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117437.012439:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789117437.012533:0:12080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:12080:1876025385478144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789117437.012557:0:12080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117437.012566:0:12080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117437.012568:0:12080:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789117437.012575:0:12080:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c178548d000 00000020:00000080:0.0:1789117437.012577:0:12080:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789117437.012650:0:12080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:12080:1876025385478272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117437.012686:0:12080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117437.012709:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385478272 00000100:00100000:0.0:1789117437.012713:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385478272 00000100:00100000:0.0:1789117437.012736:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1789117437.012742:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:12080:x1876025385478272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117437.012873:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:12080:x1876025385478272:12345-0@lo:502:llog_process_th.0 Request processed in 129us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117437.012890:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1789117437.012924:0:12080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788234d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789117437.012936:0:12080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:12080:1876025385478272:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789117437.012955:0:12080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117437.012959:0:12080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117437.012961:0:12080:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789117437.012964:0:12080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789117437.013964:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:2.0:1789117437.013988:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789117437.013997:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2044800/0xf7565228e460ded3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460deda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117437.014007:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c17c2044800/0xf7565228e460ded3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460deda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789117437.034939:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789117437.765575:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789117438.087843:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789117438.789674:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117439.813542:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117440.665691:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117440.665804:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117440.665894:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117440.665927:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117440.666052:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362375168 00000100:00100000:1.0:1789117440.666055:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362375040 00000100:00100000:1.0:1789117440.666061:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362375040 00000100:00100000:2.0:1789117440.666062:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362375168 00000100:00100000:1.0:1789117440.666325:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362375296 00000100:00100000:1.0:1789117440.666330:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362375296 00000100:00100000:0.0:1789117440.666378:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362374912 00000100:00100000:0.0:1789117440.666382:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362374912 00000100:00100000:0.0:1789117440.666442:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 298 00000100:00100000:0.0:1789117440.666453:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2349:x1876025362374912:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117440.666545:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2349:x1876025362374912:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 94us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117440.666553:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 298 00000100:00100000:0.0:1789117440.666603:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 101 00000100:00100000:0.0:1789117440.666611:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788842940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+5:2349:x1876025362375040:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117440.666644:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788842940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+5:2349:x1876025362375040:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 34us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117440.666651:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 101 00000100:00100000:2.0:1789117440.669709:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 56 00000100:00100000:2.0:1789117440.669730:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+5:2349:x1876025362375168:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117440.669806:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+5:2349:x1876025362375168:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 87us (4003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117440.669814:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 56 00000100:00080000:3.0:1789117440.671467:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789117440.671477:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117440.675988:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 102 00000100:00100000:1.0:1789117440.676003:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179198c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2349:x1876025362375296:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117440.676099:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179198c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2349:x1876025362375296:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 99us (10169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117440.676107:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 102 00010000:00010000:1.0:1789117440.839361:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789117441.156851:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:3.0:1789117441.605869:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117441.605960:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0141e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385478528:0@lo:400:kworker.0 00000100:00100000:3.0:1789117441.606148:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117441.606234:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0141a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385478400:0@lo:400:kworker.0 00000100:00100000:3.0:1789117441.606263:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117441.606833:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385478528 00000100:00100000:0.0:1789117441.606841:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385478528 00000100:00100000:0.0:1789117441.606893:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789117441.606902:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385478528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117441.606972:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385478528:12345-0@lo:400:kworker.0 Request processed in 71us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117441.606981:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789117441.607018:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0141e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385478528:0@lo:400:kworker.0 00000100:00100000:2.0:1789117441.607540:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385478400 00000100:00100000:2.0:1789117441.607545:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385478400 00000100:00100000:2.0:1789117441.607585:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789117441.607594:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3301:x1876025385478400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117441.607634:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3301:x1876025385478400:12345-0@lo:400:kworker.0 Request processed in 41us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117441.607640:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789117441.607677:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117441.607686:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385478784:0@lo:400:kworker.0 00000100:00100000:2.0:1789117441.607714:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117441.607754:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385478656:0@lo:400:kworker.0 00000100:00100000:3.0:1789117441.607758:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0143840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385479040:0@lo:400:kworker.0 00000100:00100000:3.0:1789117441.607780:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117441.607780:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117441.607804:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0141a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385478400:0@lo:400:kworker.0 00000100:00100000:2.0:1789117441.607806:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385478656 00000100:00100000:2.0:1789117441.607809:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385478656 00000100:00100000:3.0:1789117441.607816:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117441.607821:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876025385478912:0@lo:400:kworker.0 00000100:00100000:3.0:1789117441.607841:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117441.607851:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789117441.607859:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385478656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117441.607863:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385478784 00000100:00100000:3.0:1789117441.607866:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385478784 00000100:00100000:3.0:1789117441.607891:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385479040 00000100:00100000:2.0:1789117441.607892:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385478656:12345-0@lo:400:kworker.0 Request processed in 34us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117441.607893:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385479040 00000100:00100000:2.0:1789117441.607898:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789117441.607907:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385478912 00000100:00100000:3.0:1789117441.607909:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789117441.607910:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385478912 00000100:00100000:3.0:1789117441.607914:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385478784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117441.607928:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789117441.607933:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876025385478912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117441.607943:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385478784:12345-0@lo:400:kworker.0 Request processed in 29us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117441.607949:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789117441.607958:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876025385478912:12345-0@lo:400:kworker.0 Request processed in 26us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117441.607962:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789117441.607964:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789117441.607968:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385479040:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789117441.607983:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789117441.607986:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789117441.607989:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117441.607991:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385479040:12345-0@lo:400:kworker.0 Request processed in 24us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117441.607997:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789117441.608002:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1789117441.608007:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c17b7f652c0, transno 4294967300 00000100:00100000:2.0:1789117441.608016:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385478784:0@lo:400:kworker.0 00000100:00100000:2.0:1789117441.608025:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385478656:0@lo:400:kworker.0 00000100:00100000:3.0:1789117441.608136:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876025385478912:0@lo:400:kworker.0 00010000:00080000:3.0:1789117441.608151:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c0143840 x1876025385479040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117441.608160:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0143840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385479040:0@lo:400:kworker.0 00010000:00010000:0.0:1789117441.861575:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117442.118239:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385479168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117442.118329:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117442.124653:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117442.124687:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0142580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385479296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117442.124762:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385479168 00000100:00100000:2.0:1789117442.124768:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117442.124770:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385479168 00000100:00100000:3.0:1789117442.130500:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385479296 00000100:00100000:3.0:1789117442.130538:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385479296 00000100:00100000:3.0:1789117442.130609:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789117442.130620:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385479168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117442.130670:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117442.130751:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385479168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (12422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117442.130759:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789117442.130778:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789117442.130784:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385479296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117442.130804:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117442.131007:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385479296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 222us (6237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117442.131013:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789117442.131299:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0142580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385479296:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789117442.131316:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b86a8b40 x1876025385479168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117442.131333:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385479168:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789117442.885608:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117443.909539:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117444.936697:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117445.789882:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117445.789921:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117445.789945:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117445.789965:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117445.790054:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362375424 00000100:00100000:1.0:1789117445.790075:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362375424 00000100:00100000:1.0:1789117445.790123:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 300 00000100:00100000:1.0:1789117445.790134:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17830d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2352:x1876025362375424:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117445.790207:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17830d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2352:x1876025362375424:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 74us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117445.790215:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 300 00000100:00100000:2.0:1789117445.791318:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362375680 00000100:00100000:2.0:1789117445.791327:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362375680 00000100:00100000:2.0:1789117445.791383:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 59 00000100:00100000:2.0:1789117445.791392:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+5:2352:x1876025362375680:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117445.791717:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+5:2352:x1876025362375680:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 326us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117445.791725:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 59 00000100:00100000:2.0:1789117445.791749:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362375552 00000100:00100000:2.0:1789117445.791753:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362375552 00000100:00100000:2.0:1789117445.791822:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362375808 00000100:00100000:2.0:1789117445.791825:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362375808 00000100:00100000:1.0:1789117445.792869:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 106 00000100:00100000:1.0:1789117445.792883:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+5:2351:x1876025362375552:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117445.792951:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+5:2351:x1876025362375552:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 72us (3005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117445.792958:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 106 00000100:00100000:1.0:1789117445.792983:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 107 00000100:00100000:1.0:1789117445.792989:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362375808:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117445.793024:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362375808:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 35us (3059us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117445.793031:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 107 00000100:00080000:2.0:1789117445.793134:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789117445.793150:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789117445.957644:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117446.726857:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c05d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385479680:0@lo:400:kworker.0 00000100:00100000:2.0:1789117446.726931:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117446.726941:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385479424:0@lo:400:kworker.0 00000100:00100000:0.0:1789117446.726988:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117446.727025:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385479424 00000100:00100000:0.0:1789117446.727031:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385479424 00000100:00100000:0.0:1789117446.727077:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789117446.727089:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385479424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117446.727104:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117446.727114:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c05d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385479808:0@lo:400:kworker.0 00000100:00100000:0.0:1789117446.727149:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385479424:12345-0@lo:400:kworker.0 Request processed in 52us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117446.727158:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789117446.727164:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117446.727208:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385479808 00000100:00100000:2.0:1789117446.727212:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385479808 00000100:00100000:0.0:1789117446.727231:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385479424:0@lo:400:kworker.0 00000100:00100000:0.0:1789117446.727240:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c05d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876025385479936:0@lo:400:kworker.0 00000100:00100000:2.0:1789117446.727267:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789117446.727271:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117446.727280:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385479808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117446.727308:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789117446.727317:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c05d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385479552:0@lo:400:kworker.0 00000100:00100000:2.0:1789117446.727333:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385479808:12345-0@lo:400:kworker.0 Request processed in 55us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117446.727341:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789117446.727347:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789117446.727364:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117446.727370:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c05d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385480064:0@lo:400:kworker.0 00000100:00100000:2.0:1789117446.727376:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385479680 00000100:00100000:2.0:1789117446.727381:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385479680 00000100:00100000:2.0:1789117446.727445:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385479936 00000100:00100000:2.0:1789117446.727461:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385479936 00000100:00100000:2.0:1789117446.727478:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385479552 00000100:00100000:2.0:1789117446.727480:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385479552 00000100:00100000:2.0:1789117446.727492:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789117446.727497:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385479680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117446.727763:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117446.727800:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385480064 00000100:00100000:1.0:1789117446.727806:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385480064 00000100:00100000:0.0:1789117446.727818:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789117446.727828:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876025385479936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117446.727844:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789117446.727854:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385480064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117446.727872:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876025385479936:12345-0@lo:400:kworker.0 Request processed in 45us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117446.727880:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789117446.727901:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789117446.727903:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385480064:12345-0@lo:400:kworker.0 Request processed in 48us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117446.727912:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385479552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117446.727916:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789117446.727948:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385479552:12345-0@lo:400:kworker.0 Request processed in 38us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117446.727955:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789117446.727969:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c05d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385479808:0@lo:400:kworker.0 00000100:00100000:0.0:1789117446.727990:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c05d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385479552:0@lo:400:kworker.0 00010000:00080000:0.0:1789117446.728004:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c05d2580 x1876025385480064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117446.728013:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c05d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385480064:0@lo:400:kworker.0 00000100:00100000:0.0:1789117446.728022:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c05d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876025385479936:0@lo:400:kworker.0 00000100:00080000:0.0:1789117446.728049:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117446.728053:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117446.729232:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385479680:12345-0@lo:400:kworker.0 Request processed in 1728us (2296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117446.729245:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789117446.729432:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c05d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385479680:0@lo:400:kworker.0 00010000:00010000:3.0:1789117446.981912:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117447.238142:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c05d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385480320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117447.238214:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117447.238301:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789117447.238308:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385480192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117447.238333:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117447.238502:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385480320 00000100:00100000:3.0:1789117447.238511:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385480320 00000100:00100000:3.0:1789117447.238559:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385480192 00000100:00100000:3.0:1789117447.238563:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385480192 00000100:00100000:3.0:1789117447.238580:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789117447.238589:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385480320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117447.238627:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117447.238682:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385480320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117447.238703:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789117447.238720:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789117447.238727:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385480192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117447.238745:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789117447.238951:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385480192:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789117447.238977:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c05d21c0 x1876025385480320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117447.238992:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c05d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385480320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117447.239049:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385480192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 322us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117447.239057:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:0.0:1789117448.005529:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789117448.326552:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789117449.029651:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117450.053807:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117450.908549:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117450.908601:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117450.908724:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362375936 00000100:00100000:3.0:1789117450.908733:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362375936 00000100:00100000:3.0:1789117450.908806:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 302 00000100:00100000:3.0:1789117450.908816:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2352:x1876025362375936:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117450.908890:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2352:x1876025362375936:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 75us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117450.908898:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 302 00000100:00100000:0.0:1789117450.912953:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362376064 00000100:00100000:0.0:1789117450.912970:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362376064 00000100:00100000:0.0:1789117450.913076:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 111 00000100:00100000:0.0:1789117450.913089:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+5:2352:x1876025362376064:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117450.913195:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+5:2352:x1876025362376064:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 110us (4592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117450.913203:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 111 00000100:00080000:2.0:1789117450.913470:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117450.926366:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117450.926450:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117450.926602:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362376320 00000100:00100000:2.0:1789117450.926604:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362376192 00000100:00100000:2.0:1789117450.926613:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362376192 00000100:00100000:1.0:1789117450.926625:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362376320 00000100:00100000:2.0:1789117450.926749:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 19 00000100:00100000:2.0:1789117450.926759:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+5:2348:x1876025362376192:12345-192.168.206.37@tcp:9:kworker.0 00000020:00000080:2.0:1789117450.926799:0:8269:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460de16 00000100:00080000:2.0:1789117450.926808:0:8269:0:(import.c:65:import_set_state_nolock()) ffff9c1787217000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789117450.926839:0:8269:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1789117450.927098:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+2:2348:x1876025362376192:12345-192.168.206.37@tcp:9:kworker.0 Request processed in 340us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117450.927128:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 19 00010000:00010000:3.0:1789117450.927778:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789117450.929867:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789117450.929878:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117450.934182:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 112 00000100:00100000:1.0:1789117450.934197:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362376320:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117450.934286:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362376320:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 93us (7835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117450.934294:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 112 00010000:00010000:0.0:1789117451.077629:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789117451.460723:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e0c4e520-7af6-449d-969f-b46035974613 00000020:00000080:2.0:1789117451.460731:0:6713:0:(genops.c:885:class_export_put()) final put ffff9c1787215000/e0c4e520-7af6-449d-969f-b46035974613 00000020:00000080:1.0:1789117451.461241:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1787215000/e0c4e520-7af6-449d-969f-b46035974613 for lustre-OST0000 00000020:00000080:1.0:1789117451.461349:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c1787217000 for lustre-OST0000 00000100:00100000:0.0:1789117451.847274:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1683959e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385480832:0@lo:400:kworker.0 00000100:00100000:0.0:1789117451.847335:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117451.847391:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789117451.847397:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385480704:0@lo:400:kworker.0 00000100:00100000:0.0:1789117451.847447:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117451.847473:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385480832 00000100:00100000:0.0:1789117451.847479:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385480832 00000100:00100000:0.0:1789117451.847523:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789117451.847530:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385480832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117451.847570:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385480832:12345-0@lo:400:kworker.0 Request processed in 41us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117451.847870:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385480448:0@lo:400:kworker.0 00000100:00100000:2.0:1789117451.847901:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117451.847922:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c168395a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876025385480960:0@lo:400:kworker.0 00000100:00100000:2.0:1789117451.847939:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117451.847952:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789117451.847957:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385480576:0@lo:400:kworker.0 00000100:00100000:2.0:1789117451.847988:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117451.848003:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17a7d7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385481088:0@lo:400:kworker.0 00000100:00100000:2.0:1789117451.848019:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117451.848043:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385480704 00000100:00100000:2.0:1789117451.848046:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385480704 00000100:00100000:2.0:1789117451.848068:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385480960 00000100:00100000:2.0:1789117451.848070:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385480960 00000100:00100000:2.0:1789117451.848079:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385480576 00000100:00100000:2.0:1789117451.848081:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385480576 00000100:00100000:2.0:1789117451.848090:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789117451.848095:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385480704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117451.848135:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385480704:12345-0@lo:400:kworker.0 Request processed in 39us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117451.848141:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789117451.848155:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789117451.848160:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876025385480960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117451.848194:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876025385480960:12345-0@lo:400:kworker.0 Request processed in 34us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117451.848200:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789117451.848210:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789117451.848215:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385480576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117451.848233:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385480576:12345-0@lo:400:kworker.0 Request processed in 19us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117451.848239:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789117451.848251:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385481088 00000100:00100000:2.0:1789117451.848254:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385481088 00000100:00100000:3.0:1789117451.848332:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385480576:0@lo:400:kworker.0 00000100:00100000:3.0:1789117451.848341:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c168395a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876025385480960:0@lo:400:kworker.0 00000100:00080000:3.0:1789117451.848367:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789117451.848370:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117451.848372:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117451.848585:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789117451.848630:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385480704:0@lo:400:kworker.0 00000100:00100000:0.0:1789117451.848640:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1683959e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385480832:0@lo:400:kworker.0 00000100:00100000:1.0:1789117451.849220:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385480448 00000100:00100000:1.0:1789117451.849225:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385480448 00000100:00100000:1.0:1789117451.849268:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789117451.849275:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385480448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117451.849329:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385480448:12345-0@lo:400:kworker.0 Request processed in 54us (1426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117451.849335:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789117451.851175:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385480448:0@lo:400:kworker.0 00000100:00100000:2.0:1789117451.856997:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789117451.857017:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385481088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117451.857115:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385481088:12345-0@lo:400:kworker.0 Request processed in 100us (9086us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117451.857123:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1789117451.857198:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17a7d7b0c0 x1876025385481088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117451.857212:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17a7d7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385481088:0@lo:400:kworker.0 00010000:00010000:3.0:1789117452.101683:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117452.359260:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c05d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385481216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117452.359329:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117452.359429:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117452.359437:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0141680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385481344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117452.359460:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117452.359525:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385481216 00000100:00100000:3.0:1789117452.359543:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385481216 00000100:00100000:3.0:1789117452.359576:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385481344 00000100:00100000:3.0:1789117452.359579:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385481344 00000100:00100000:3.0:1789117452.359592:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789117452.359599:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385481216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117452.359630:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117452.359679:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385481216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117452.359687:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789117452.359701:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789117452.359707:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385481344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117452.359723:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789117452.359746:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385481344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117452.359752:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789117452.359832:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0141680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385481344:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789117452.359846:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c05d3c00 x1876025385481216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117452.359857:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c05d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385481216:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789117453.125600:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117454.149857:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117455.173550:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117456.030062:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117456.030116:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117456.030268:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362376576 00000100:00100000:2.0:1789117456.030288:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362376576 00000100:00100000:2.0:1789117456.030355:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 116 00000100:00100000:2.0:1789117456.030365:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+5:2350:x1876025362376576:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117456.030467:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+5:2350:x1876025362376576:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 103us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117456.030476:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 116 00000100:00100000:1.0:1789117456.030919:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362376448 00000100:00100000:1.0:1789117456.030925:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362376448 00000100:00100000:1.0:1789117456.030954:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 304 00000100:00100000:1.0:1789117456.030961:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2349:x1876025362376448:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117456.030998:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2349:x1876025362376448:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 37us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117456.031004:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 304 00000100:00080000:3.0:1789117456.031987:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117456.044993:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117456.046078:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362376704 00000100:00100000:1.0:1789117456.046099:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362376704 00000100:00080000:3.0:1789117456.046212:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117456.046244:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 117 00000100:00100000:1.0:1789117456.046795:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2349:x1876025362376704:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117456.047740:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2349:x1876025362376704:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 1484us (2751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117456.047751:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 117 00010000:00010000:0.0:1789117456.198036:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117456.968957:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c05d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385481728:0@lo:400:kworker.0 00000100:00100000:3.0:1789117456.969023:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117456.969103:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117456.969110:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c05d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385481856:0@lo:400:kworker.0 00000100:00100000:1.0:1789117456.969223:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c05d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385481472:0@lo:400:kworker.0 00000100:00100000:1.0:1789117456.969258:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117456.969283:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c05d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876025385481984:0@lo:400:kworker.0 00000100:00100000:1.0:1789117456.969318:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117456.969340:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789117456.969578:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c05d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385481600:0@lo:400:kworker.0 00000100:00100000:1.0:1789117456.969606:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117456.969625:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c05d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385482112:0@lo:400:kworker.0 00000100:00100000:1.0:1789117456.969647:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117456.969677:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385481728 00000100:00100000:1.0:1789117456.969684:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385481728 00000100:00100000:1.0:1789117456.969728:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385481984 00000100:00100000:1.0:1789117456.969731:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385481984 00000100:00100000:1.0:1789117456.969744:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385481600 00000100:00100000:1.0:1789117456.969746:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385481600 00000100:00100000:1.0:1789117456.969759:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789117456.969766:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385481728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117456.969811:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385481728:12345-0@lo:400:kworker.0 Request processed in 46us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117456.969818:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789117456.969833:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789117456.969853:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876025385481984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117456.969888:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876025385481984:12345-0@lo:400:kworker.0 Request processed in 36us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117456.969894:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789117456.969907:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789117456.969913:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385481600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117456.969939:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385481600:12345-0@lo:400:kworker.0 Request processed in 26us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117456.969945:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789117456.969965:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385482112 00000100:00100000:1.0:1789117456.969968:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385482112 00000100:00100000:1.0:1789117456.969994:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789117456.970000:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0142580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385482112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117456.970029:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0142580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385482112:12345-0@lo:400:kworker.0 Request processed in 29us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117456.970035:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1789117456.970050:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117456.970053:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117456.970095:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c05d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385481600:0@lo:400:kworker.0 00010000:00080000:1.0:1789117456.970108:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c05d1e00 x1876025385482112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117456.970117:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c05d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385482112:0@lo:400:kworker.0 00000100:00100000:3.0:1789117456.970972:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117456.971020:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c05d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385481728:0@lo:400:kworker.0 00000100:00100000:3.0:1789117456.971061:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385481472 00000100:00100000:3.0:1789117456.971075:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385481472 00000100:00100000:3.0:1789117456.971802:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789117456.971816:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385481472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117456.971872:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385481472:12345-0@lo:400:kworker.0 Request processed in 60us (2613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117456.971879:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789117456.972134:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385481856 00000100:00100000:0.0:1789117456.972139:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385481856 00000100:00100000:0.0:1789117456.972181:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789117456.972187:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385481856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117456.972231:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385481856:12345-0@lo:400:kworker.0 Request processed in 44us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117456.972237:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789117456.972272:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c05d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385481856:0@lo:400:kworker.0 00000100:00080000:3.0:1789117456.973750:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117456.973895:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c05d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876025385481984:0@lo:400:kworker.0 00000100:00100000:1.0:1789117456.973923:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c05d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385481472:0@lo:400:kworker.0 00010000:00010000:0.0:1789117457.221553:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117457.478036:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0143840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385482240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117457.478126:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117457.478252:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385482240 00000100:00100000:1.0:1789117457.478260:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385482240 00000100:00100000:1.0:1789117457.478307:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789117457.478316:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385482240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117457.478347:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1789117457.478391:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385482240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117457.478421:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789117457.478462:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0143840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385482240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117457.478867:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117457.478878:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c05d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385482368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117457.478910:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117457.478958:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385482368 00000100:00100000:3.0:1789117457.478965:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385482368 00000100:00100000:3.0:1789117457.479001:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789117457.479010:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0143840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385482368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117457.479032:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117457.479094:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0143840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385482368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117457.479100:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1789117457.479171:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c05d2d00 x1876025385482368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117457.479185:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c05d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385482368:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789117458.245572:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789117458.566717:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789117459.269508:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789117459.452928:0:12248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 05:04:17 (1789117457) 00010000:00010000:0.0:1789117460.293780:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117460.880559:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117460.880704:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362376832 00000100:00100000:2.0:1789117460.880713:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362376832 00000100:00100000:2.0:1789117460.880781:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 32 00000100:00100000:2.0:1789117460.880792:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+5:10441:x1876025362376832:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117460.880810:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117460.880831:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460dee1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c79f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117460.880889:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460dee8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117460.880901:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460dee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117460.880914:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460dee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117460.881124:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789117460.881128:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789117460.881508:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460dee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117460.881536:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460dee1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c79f expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117460.881559:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460dee8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c79f expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117460.881568:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1783e89a00) 00010000:00010000:2.0:1789117460.881571:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789117460.881574:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457ec00, rc 0) 00000100:00100000:2.0:1789117460.881689:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+6:10441:x1876025362376832:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 899us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117460.881697:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 32 00000100:00080000:3.0:1789117460.881816:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117460.898463:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117460.903847:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362376960 00000100:00100000:1.0:1789117460.903862:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362376960 00000100:00100000:1.0:1789117460.903936:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 33 00000100:00100000:1.0:1789117460.903946:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+6:10442:x1876025362376960:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789117460.903965:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117460.903986:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460deef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c7a6 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.904082:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460def6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.904105:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460def6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.904118:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460def6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.904132:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460defd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.904140:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460defd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.904147:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460defd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.904601:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460df04 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.904611:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460df04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.904896:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460df04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117460.904998:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1789117460.905003:0:7242:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789117460.909864:0:7242:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460df04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.909907:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460def6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.909914:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460def6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.909920:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460def6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.909926:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ea00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117460.909930:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460def6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.909937:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460def6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.909951:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1783e89a00) 00010000:00010000:1.0:1789117460.909954:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117460.909958:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460def6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.909964:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460def6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.909978:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460defd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.909984:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460defd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.909989:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460defd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.909999:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117460.910002:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460defd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.910007:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460defd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.910015:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c1788d9ed00) 00010000:00010000:1.0:1789117460.910018:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117460.910021:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460defd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.910027:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460defd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.910081:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460deef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7a6 expref: 8 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.912500:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460df04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7a6 expref: 7 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.912517:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c1788d9e300) 00010000:00010000:1.0:1789117460.912520:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789117460.912524:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442f400, rc 0) 00000100:00100000:1.0:1789117460.912595:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+7:10442:x1876025362376960:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 8650us (14141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117460.912604:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 33 00000100:00100000:0.0:1789117460.924122:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117460.924264:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362377216 00000100:00100000:1.0:1789117460.924283:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362377216 00000100:00100000:1.0:1789117460.924340:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 34 00000100:00100000:1.0:1789117460.924350:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+7:10442:x1876025362377216:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789117460.924369:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117460.924432:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460df0b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c7ad expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.924507:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460df12 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.924520:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460df12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.924530:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460df12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.924583:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460df19 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.924591:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460df19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.924597:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460df19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.925275:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f200/0xf7565228e460df20 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.925286:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f200/0xf7565228e460df20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.925293:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f200/0xf7565228e460df20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117460.925308:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1789117460.925574:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460df12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.925582:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460df12 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.925590:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460df12 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.925596:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117460.925600:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460df12 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.925607:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460df12 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.925618:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c1788d9e300) 00010000:00010000:1.0:1789117460.925621:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117460.925625:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460df12 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.925631:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460df12 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.925643:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460df19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.925649:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460df19 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.925664:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460df19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.925669:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ea00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117460.925673:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460df19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.925679:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460df19 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.925687:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c1788d9ed00) 00010000:00010000:1.0:1789117460.925689:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117460.925692:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460df19 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117460.925698:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460df19 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117460.929245:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460df0b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7ad expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117460.929274:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f200/0xf7565228e460df20 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7ad expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117460.929283:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1788d9e000) 00010000:00010000:2.0:1789117460.929287:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117460.929290:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442f200, rc 0) 00000100:00100000:2.0:1789117460.929369:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+9:10442:x1876025362377216:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 5020us (5257us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789117460.929378:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 34 00000100:00100000:0.0:1789117460.934800:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117460.934900:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362377344 00000100:00100000:3.0:1789117460.934910:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362377344 00000100:00100000:3.0:1789117460.934968:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 35 00000100:00100000:3.0:1789117460.934978:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+9:10442:x1876025362377344:12345-192.168.206.37@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789117460.935430:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+9:10442:x1876025362377344:12345-192.168.206.37@tcp:59:lhsmtool_posix.0 Request processed in 451us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117460.935439:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 35 00000100:00100000:3.0:1789117461.152935:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117461.152979:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117461.153015:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117461.153120:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362377728 00000100:00100000:1.0:1789117461.153130:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362377728 00000100:00100000:1.0:1789117461.153188:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362377600 00000100:00100000:1.0:1789117461.153191:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362377600 00000100:00100000:1.0:1789117461.153211:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 121 00000100:00100000:1.0:1789117461.153219:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2350:x1876025362377728:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117461.153285:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2350:x1876025362377728:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 66us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117461.153293:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 121 00000100:00100000:1.0:1789117461.153310:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 122 00000100:00100000:1.0:1789117461.153317:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+9:2350:x1876025362377600:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117461.153352:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+9:2350:x1876025362377600:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 36us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117461.153359:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 122 00000100:00100000:2.0:1789117461.153560:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362377472 00000100:00100000:2.0:1789117461.153564:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362377472 00000100:00100000:2.0:1789117461.153602:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 306 00000100:00100000:2.0:1789117461.153608:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2350:x1876025362377472:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117461.153650:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2350:x1876025362377472:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 42us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117461.153657:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 306 00000100:00080000:3.0:1789117461.153945:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789117461.317723:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789117461.638709:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:3.0:1789117461.645541:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:3.0:1789117462.086484:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385482624:0@lo:400:kworker.0 00000100:00100000:2.0:1789117462.086508:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385482880:0@lo:400:kworker.0 00000100:00100000:1.0:1789117462.086575:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385482496:0@lo:400:kworker.0 00000100:00100000:2.0:1789117462.090725:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117462.090788:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117462.090800:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385482752:0@lo:400:kworker.0 00000100:00100000:2.0:1789117462.090854:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117462.091203:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117462.091244:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385483136:0@lo:400:kworker.0 00000100:00100000:3.0:1789117462.091272:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117462.093503:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385482752 00000100:00100000:2.0:1789117462.093516:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385482752 00000100:00080000:3.0:1789117462.093555:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117462.093579:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385482624 00000100:00100000:2.0:1789117462.093583:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385482624 00000100:00100000:3.0:1789117462.093595:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789117462.093611:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385482752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117462.093698:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385482752:12345-0@lo:400:kworker.0 Request processed in 95us (2842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117462.095863:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117462.095917:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876025385483008:0@lo:400:kworker.0 00000100:00100000:1.0:1789117462.095954:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117462.095996:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385482880 00000100:00100000:1.0:1789117462.096002:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385482880 00000100:00100000:1.0:1789117462.096067:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385483136 00000100:00100000:1.0:1789117462.096070:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385483136 00000100:00100000:1.0:1789117462.096090:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789117462.096098:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385482880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117462.096141:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385482880:12345-0@lo:400:kworker.0 Request processed in 44us (5423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117462.096148:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789117462.096163:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789117462.096169:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385483136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117462.096200:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385483136:12345-0@lo:400:kworker.0 Request processed in 31us (4928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117462.096205:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789117462.096220:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385483008 00000100:00100000:1.0:1789117462.096223:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385483008 00000100:00100000:2.0:1789117462.096493:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789117462.096502:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385482624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117462.096547:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385482624:12345-0@lo:400:kworker.0 Request processed in 37us (5334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117462.096553:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789117462.097281:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385482752:0@lo:400:kworker.0 00000100:00100000:2.0:1789117462.097293:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385482880:0@lo:400:kworker.0 00000100:00100000:2.0:1789117462.097470:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385482496 00000100:00100000:2.0:1789117462.097474:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385482496 00000100:00100000:2.0:1789117462.097506:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789117462.097513:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385482496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117462.097567:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385482496:12345-0@lo:400:kworker.0 Request processed in 55us (1710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117462.097580:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:2.0:1789117462.097609:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789117462.097614:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789117462.097617:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117462.099501:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:0.0:1789117462.102512:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17b85c0b40 x1876025385483136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789117478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117462.102531:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385483136:0@lo:400:kworker.0 00000100:00100000:0.0:1789117462.102547:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385482624:0@lo:400:kworker.0 00000100:00100000:1.0:1789117462.103031:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789117462.103046:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876025385483008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117462.103134:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876025385483008:12345-0@lo:400:kworker.0 Request processed in 94us (7178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117462.103153:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789117462.103189:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385482496:0@lo:400:kworker.0 00000100:00100000:1.0:1789117462.103202:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876025385483008:0@lo:400:kworker.0 00010000:00010000:0.0:1789117462.341871:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117462.597824:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0141a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385483264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117462.597892:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117462.597955:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117462.597961:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c05d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385483392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117462.597986:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117462.598139:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385483264 00000100:00100000:3.0:1789117462.598147:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385483264 00000100:00100000:3.0:1789117462.598179:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385483392 00000100:00100000:3.0:1789117462.598182:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385483392 00000100:00100000:3.0:1789117462.598197:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789117462.598204:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385483264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117462.598238:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789117462.598290:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385483264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117462.598297:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789117462.598314:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789117462.598321:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385483392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117462.598338:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117462.598376:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385483392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117462.598395:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1789117462.598627:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c05d0b40 x1876025385483392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117462.598646:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c05d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385483392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117462.598661:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0141a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385483264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117462.994036:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117462.995486:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362377856 00000100:00100000:2.0:1789117462.995499:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362377856 00000100:00100000:2.0:1789117462.995581:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 36 00000100:00100000:2.0:1789117462.995591:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+8:10484:x1876025362377856:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:2.0:1789117462.995609:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117462.995628:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460df2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c7b4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.995687:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460df35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.995702:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460df35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.995725:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460df35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.995740:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460df3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.995747:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460df3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.995753:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460df3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.995999:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460df35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789117462.996300:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789117462.996330:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460df35 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.996337:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460df35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.996342:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457fa00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117462.996346:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460df35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.996353:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460df35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.996365:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1783e89a00) 00010000:00010000:2.0:1789117462.996368:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117462.996372:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460df35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.996386:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460df35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.996470:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460df3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.996478:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460df3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.996484:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460df3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.996490:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117462.996493:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460df3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.996500:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460df3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.996508:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c1783e89f00) 00010000:00010000:2.0:1789117462.996511:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117462.996514:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460df3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.996520:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460df3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.996554:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460df2e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7b4 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.996576:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1783e89a00) 00010000:00010000:2.0:1789117462.996578:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117462.996583:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460df2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7b4 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117462.996592:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457e600, rc 0) 00000100:00100000:2.0:1789117462.996774:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+8:10484:x1876025362377856:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 1183us (2747us total) trans 0 rc 301/301 00000100:00100000:2.0:1789117462.996783:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 36 00000100:00100000:2.0:1789117463.010628:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117463.010695:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362378112 00000100:00100000:1.0:1789117463.010704:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362378112 00000100:00100000:1.0:1789117463.010770:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 37 00000100:00100000:1.0:1789117463.010781:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+8:10484:x1876025362378112:12345-192.168.206.37@tcp:36:lfs.0 00010000:00010000:1.0:1789117463.010831:0:7242:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117463.010856:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460dee8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c79f expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.010871:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1783e89a00) 00010000:00010000:1.0:1789117463.010881:0:7242:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789117463.011354:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460df43 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.011465:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460df43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.011476:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460df43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.011489:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df4a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.011496:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.011513:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117463.020313:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1789117463.020334:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460df43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.020345:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460df43 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.020352:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460df43 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.020357:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117463.020372:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460df43 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.020380:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460df43 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.020395:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9ef00) 00010000:00010000:1.0:1789117463.020580:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117463.020586:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460df43 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.020593:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460df43 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789117463.020612:0:7242:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000fb54c8f8 reply state 0000000087f65b1c transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117463.020633:0:7242:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789117463.020784:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+9:10484:x1876025362378112:12345-192.168.206.37@tcp:36:lfs.0 Request processed in 10001us (10159us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789117463.020793:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 37 00010000:00010000:3.0:1789117463.026240:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117463.026258:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df4a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117463.026266:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df4a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117463.026273:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ee00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117463.026278:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df4a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117463.026286:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df4a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117463.026302:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c1788d9ed00) 00010000:00010000:3.0:1789117463.026305:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117463.026310:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df4a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117463.026317:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df4a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117463.135739:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117463.135810:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362378240 00000100:00100000:1.0:1789117463.135820:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362378240 00000100:00100000:1.0:1789117463.135883:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 38 00000100:00100000:1.0:1789117463.135895:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+8:10492:x1876025362378240:12345-192.168.206.37@tcp:101:lctl.0 00010000:00010000:1.0:1789117463.135919:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117463.135939:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460df51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c7bb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.135994:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fc00/0xf7565228e460df58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.136007:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fc00/0xf7565228e460df58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.136017:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fc00/0xf7565228e460df58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117463.136081:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789117463.136085:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789117463.136123:0:5839:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fc00/0xf7565228e460df58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.136144:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460df51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7bb expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.136178:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fc00/0xf7565228e460df58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7bb expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.136186:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9ef00) 00010000:00010000:1.0:1789117463.136188:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789117463.136191:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442fc00, rc 0) 00000100:00100000:1.0:1789117463.136249:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+9:10492:x1876025362378240:12345-192.168.206.37@tcp:101:lctl.0 Request processed in 356us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117463.136256:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 38 00000100:00100000:2.0:1789117463.180236:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117463.180522:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362378368 00000100:00100000:1.0:1789117463.180596:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362378368 00000100:00100000:1.0:1789117463.180688:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 39 00000100:00100000:1.0:1789117463.180698:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+9:10498:x1876025362378368:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:1.0:1789117463.180719:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117463.180738:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460df5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c7c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.180800:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.180826:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.180837:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.180853:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460df6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.180872:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460df6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.180879:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460df6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.181275:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f800/0xf7565228e460df74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.181286:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f800/0xf7565228e460df74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.181294:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f800/0xf7565228e460df74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117463.181330:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1789117463.181334:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789117463.181722:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f800/0xf7565228e460df74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.181734:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.181740:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df66 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.181747:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.181752:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ee00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117463.181756:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.181772:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df66 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.181784:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9ef00) 00010000:00010000:1.0:1789117463.181787:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117463.181792:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.181798:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.181867:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460df6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.181874:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460df6d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.181880:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460df6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.181885:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442fe00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117463.181887:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460df6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.181893:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460df6d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.181901:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c1788d9e700) 00010000:00010000:1.0:1789117463.181903:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117463.181906:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460df6d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.181921:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460df6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.181953:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460df5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7c2 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.181966:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f800/0xf7565228e460df74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7c2 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.181973:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:1.0:1789117463.181975:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789117463.181978:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442f800, rc 0) 00000100:00100000:1.0:1789117463.182507:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+10:10498:x1876025362378368:12345-192.168.206.37@tcp:101:bash.0 Request processed in 1808us (2277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117463.182516:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 39 00000100:00100000:3.0:1789117463.185752:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117463.189482:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362378624 00000100:00100000:1.0:1789117463.189497:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362378624 00000100:00100000:1.0:1789117463.190433:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 40 00000100:00100000:1.0:1789117463.190449:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+10:10498:x1876025362378624:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:1.0:1789117463.190469:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117463.190489:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460df7b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c7c9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.190625:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460df82 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.190639:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460df82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.190664:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460df82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.190724:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.190732:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.190739:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789117463.193257:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789117463.193613:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460df90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.193627:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460df90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.193637:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460df90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.193670:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460df82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.193677:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460df82 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.193683:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460df82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.193689:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442fe00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117463.193701:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460df82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.193709:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460df82 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.193721:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:1.0:1789117463.193723:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117463.193727:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460df82 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.193734:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460df82 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789117463.193748:0:5839:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004afc18cd reply state 000000004ba0f0d3 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117463.193757:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789117463.193791:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460df7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7c9 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.193804:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460df90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7c9 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.193812:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9ea00) 00010000:00010000:1.0:1789117463.193814:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117463.193816:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e400, rc 0) 00000100:00100000:1.0:1789117463.194159:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+13:10498:x1876025362378624:12345-192.168.206.37@tcp:101:bash.0 Request processed in 3713us (8413us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789117463.194169:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 40 00000100:00100000:3.0:1789117463.199696:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117463.199856:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362378752 00000100:00100000:0.0:1789117463.199865:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362378752 00000100:00100000:0.0:1789117463.199918:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 20 00000100:00100000:0.0:1789117463.199925:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1876025362378752:12345-192.168.206.37@tcp:8:bash.0 00010000:00080000:0.0:1789117463.199966:0:6687:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:0.0:1789117463.199993:0:6687:0:(genops.c:1385:class_connect()) connect: client e0c4e520-7af6-449d-969f-b46035974613, cookie 0xf7565228e460df9e 00002000:00100000:0.0:1789117463.200015:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e0c4e520-7af6-449d-969f-b46035974613/ffff9c17bfa8e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789117463.200031:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00010000:00010000:1.0:1789117463.200221:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.200233:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.200240:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.200247:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ee00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117463.200251:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.200258:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.200273:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c1788d9e700) 00010000:00010000:1.0:1789117463.200276:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117463.200280:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.200286:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460df89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789117463.201265:0:6687:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789117463.201301:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9c17bfa8f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789117463.201384:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+6:2348:x1876025362378752:12345-192.168.206.37@tcp:8:bash.0 Request processed in 1455us (1695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117463.201393:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 20 00000100:00100000:2.0:1789117463.205958:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117463.206336:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362378880 00000100:00100000:0.0:1789117463.206347:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362378880 00000100:00100000:0.0:1789117463.206454:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 21 00000100:00100000:0.0:1789117463.206465:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+6:0:x1876025362378880:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:0.0:1789117463.206495:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117463.206515:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053851bab/0xf7565228e460dfa5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c7d0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789117463.206618:0:8269:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789117463.206636:0:8269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=310s v=(0 0) 00010000:00010000:0.0:1789117463.206641:0:8269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117463.206651:0:8269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053851bab/0xf7565228e460dfa5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d0 expref: 7 pid: 8269 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.206670:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000053851bab/0xf7565228e460dfa5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d0 expref: 7 pid: 8269 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.206684:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbd000, rc 0) 00000100:00100000:0.0:1789117463.206744:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+7:0:x1876025362378880:12345-192.168.206.37@tcp:101:bash.0 Request processed in 281us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117463.206752:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 21 00000100:00080000:3.0:1789117463.209074:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117463.216379:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117463.218539:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362379008 00000100:00100000:1.0:1789117463.218552:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362379008 00000100:00100000:1.0:1789117463.218635:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 22 00000100:00100000:1.0:1789117463.218645:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+7:10498:x1876025362379008:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:1.0:1789117463.218663:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117463.218683:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082aae0b7/0xf7565228e460dfac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c7d7 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.218730:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000053851bab/0xf7565228e460dfa5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d0 expref: 8 pid: 8269 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.218740:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117463.218744:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117463.218750:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082aae0b7/0xf7565228e460dfac lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d7 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.218784:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000053851bab/0xf7565228e460dfa5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d0 expref: 8 pid: 8269 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.218798:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000053851bab/0xf7565228e460dfa5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d0 expref: 8 pid: 8269 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117463.218813:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0141e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1876025385483520:192.168.206.37@tcp:104: 00000100:00100000:1.0:1789117463.218915:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788257480 going to sleep for 11 seconds 00000100:00100000:2.0:1789117463.225033:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117463.225144:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362379136 00000100:00100000:1.0:1789117463.225150:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0141e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1876025385483520:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117463.225165:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362379136 00010000:00010000:1.0:1789117463.225186:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000082aae0b7/0xf7565228e460dfac lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d7 expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117463.225200:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000053851bab/0xf7565228e460dfa5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d0 expref: 9 pid: 8269 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.225209:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442ee00, rc 0) 00000100:00100000:3.0:1789117463.225242:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 40 00000100:00100000:3.0:1789117463.225253:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+9:2349:x1876025362379136:12345-192.168.206.37@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789117463.225262:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+9:10498:x1876025362379008:12345-192.168.206.37@tcp:101:bash.0 Request processed in 6618us (8904us total) trans 0 rc 0/0 00010000:00010000:3.0:1789117463.225267:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789117463.225272:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 22 00010000:00010000:3.0:1789117463.225292:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000053851bab/0xf7565228e460dfa5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d0 expref: 9 pid: 8269 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117463.225306:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000053851bab/0xf7565228e460dfa5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d0 expref: 8 pid: 8269 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117463.225331:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053851bab/0xf7565228e460dfa5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d0 expref: 8 pid: 8269 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117463.225346:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117463.225351:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117463.225358:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082aae0b7/0xf7565228e460dfac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d7 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117463.225382:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082aae0b7/0xf7565228e460dfac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d7 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117463.225458:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000082aae0b7/0xf7565228e460dfac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d7 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117463.225487:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c05d1e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5826:1876025385483648:192.168.206.37@tcp:105: 00000100:00100000:3.0:1789117463.225558:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1782dfd180 going to sleep for 11 seconds 00000100:00100000:2.0:1789117463.229656:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117463.229792:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c05d1e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5826:1876025385483648:192.168.206.37@tcp:105: 00010000:00010000:3.0:1789117463.229812:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117463.230275:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362379392 00000100:00100000:0.0:1789117463.230283:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362379392 00000100:00100000:0.0:1789117463.230345:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 6 00000100:00100000:0.0:1789117463.230356:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+12:10498:x1876025362379392:12345-192.168.206.37@tcp:35:bash.0 00000100:00100000:0.0:1789117463.230935:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+13:10498:x1876025362379392:12345-192.168.206.37@tcp:35:bash.0 Request processed in 577us (1284us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789117463.230944:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 6 00000100:00100000:2.0:1789117463.235179:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+7:2349:x1876025362379136:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 9916us (10144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117463.235193:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 40 00000100:00100000:2.0:1789117463.331835:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117463.331942:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362379648 00000100:00100000:1.0:1789117463.331950:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362379648 00000100:00100000:1.0:1789117463.332007:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 41 00000100:00100000:1.0:1789117463.332017:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+13:10509:x1876025362379648:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117463.332038:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117463.332068:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460dfb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c7de expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117463.332172:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1789117463.332283:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460dfb3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7de expref: 15 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.332298:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9ef00) 00010000:00010000:1.0:1789117463.332300:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789117463.332306:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460dfb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7de expref: 15 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.332320:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442fe00, rc 0) 00000100:00100000:1.0:1789117463.332390:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+14:10509:x1876025362379648:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 375us (564us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1789117463.332443:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 41 00000100:00100000:0.0:1789117463.336095:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117463.336165:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362379904 00000100:00100000:1.0:1789117463.336174:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362379904 00000100:00100000:1.0:1789117463.336228:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 7 00000100:00100000:1.0:1789117463.336237:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+14:10509:x1876025362379904:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:1.0:1789117463.336517:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+15:10509:x1876025362379904:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 280us (429us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789117463.336547:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 7 00010000:00010000:0.0:1789117463.365675:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117463.424903:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117463.432492:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362380032 00000100:00100000:2.0:1789117463.432506:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362380032 00000100:00100000:2.0:1789117463.432583:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 42 00000100:00100000:2.0:1789117463.432593:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+15:10515:x1876025362380032:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:2.0:1789117463.432614:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117463.432656:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460dfc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c7e5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117463.432734:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460dfc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117463.432747:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460dfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117463.432759:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460dfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117463.432810:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1789117463.432814:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789117463.432852:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460dfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117463.432877:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460dfc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7e5 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117463.432895:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460dfc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7e5 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117463.432903:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:2.0:1789117463.432906:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789117463.432909:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f800, rc 0) 00000100:00100000:2.0:1789117463.432979:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+16:10515:x1876025362380032:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 387us (8083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117463.432987:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 42 00000100:00100000:2.0:1789117463.442035:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117463.442149:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362380288 00000100:00100000:1.0:1789117463.442159:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362380288 00000100:00100000:1.0:1789117463.442215:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 43 00000100:00100000:1.0:1789117463.442226:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+16:10515:x1876025362380288:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117463.442244:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117463.442263:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460dfcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c7ec expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.442356:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460dfd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.442381:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460dfd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.442393:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460dfd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117463.442431:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789117463.442562:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460dfcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7ec expref: 19 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.442581:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460dfd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7ec expref: 18 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.442589:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9ea00) 00010000:00010000:1.0:1789117463.442592:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117463.442595:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442fa00, rc 0) 00000100:00100000:1.0:1789117463.442662:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+18:10515:x1876025362380288:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 438us (636us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789117463.442669:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 43 00000100:00100000:3.0:1789117463.447129:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117463.447219:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362380544 00000100:00100000:2.0:1789117463.447228:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362380544 00000100:00100000:2.0:1789117463.447281:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 44 00000100:00100000:2.0:1789117463.447291:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+18:10515:x1876025362380544:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:2.0:1789117463.447313:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117463.447330:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460dfe4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c7f3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117463.448134:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460dfeb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117463.448150:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460dfeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117463.448162:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460dfeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117463.448175:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789117463.448289:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460dfe4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7f3 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117463.448307:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460dfeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7f3 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117463.448316:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9ea00) 00010000:00010000:3.0:1789117463.448319:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789117463.448323:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781684000, rc 0) 00000100:00100000:3.0:1789117463.448393:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+20:10515:x1876025362380544:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 1103us (1272us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789117463.449190:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 44 00000100:00100000:3.0:1789117463.452127:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117463.452323:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362380672 00000100:00100000:1.0:1789117463.452332:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362380672 00000100:00100000:1.0:1789117463.452395:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 2 00000100:00100000:1.0:1789117463.452436:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+20:2350:x1876025362380672:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117463.452451:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117463.452474:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460dfd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7ec expref: 20 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.452494:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9ea00) 00010000:00010000:1.0:1789117463.452499:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117463.452549:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+19:2350:x1876025362380672:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 116us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117463.452556:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 2 00000100:00100000:2.0:1789117463.460282:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117463.460355:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362380800 00000100:00100000:1.0:1789117463.460372:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362380800 00000100:00100000:1.0:1789117463.460445:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 23 00000100:00100000:1.0:1789117463.460455:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+7:2352:x1876025362380800:12345-192.168.206.37@tcp:1:lfs.0 00010000:00010000:1.0:1789117463.460496:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c7c01f9/0xf7565228e460dff9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.460513:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000082aae0b7/0xf7565228e460dfac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d7 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.460535:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117463.460553:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789117463.460558:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c7c01f9/0xf7565228e460dff9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.460590:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000082aae0b7/0xf7565228e460dfac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d7 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.460604:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000082aae0b7/0xf7565228e460dfac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d7 expref: 7 pid: 6685 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117463.460617:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0141e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6686:1876025385483776:192.168.206.37@tcp:104: 00000100:00100000:1.0:1789117463.461172:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788257e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789117463.470394:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117463.470523:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362380928 00000100:00100000:0.0:1789117463.470532:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362380928 00002000:00100000:0.0:1789117463.470578:0:6690:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9c17b87a1e00 x1876025362380928/t0(0) o4->e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp:14/0 lens 504/0 e 0 to 0 dl 1789117474 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789117463.470589:0:6690:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c17b87a1e00 with x1876025362380928 ext(0->12) 00010000:00010000:0.0:1789117463.470598:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000082aae0b7/0xf7565228e460dfac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d7 expref: 8 pid: 6685 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.470614:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000082aae0b7/0xf7565228e460dfac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d7 expref: 8 pid: 6685 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789117463.470621:0:6690:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c17b87a1e00 00000100:00100000:0.0:1789117463.470661:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 0 00000100:00100000:0.0:1789117463.470670:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e0c4e520-7af6-449d-969f-b46035974613+8:2349:x1876025362380928:12345-192.168.206.37@tcp:4:lfs.0 00000100:00100000:1.0:1789117463.475136:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0141e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6686:1876025385483776:192.168.206.37@tcp:104: 00010000:00010000:1.0:1789117463.475168:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001c7c01f9/0xf7565228e460dff9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1789117463.509149:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e0c4e520-7af6-449d-969f-b46035974613 00000100:00100000:2.0:1789117463.509874:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e0c4e520-7af6-449d-969f-b46035974613+9:2349:x1876025362380928:12345-192.168.206.37@tcp:4:lfs.0 Request processed in 39197us (39481us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789117463.509892:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 0 00002000:00100000:2.0:1789117463.509905:0:6690:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9c17b87a1e00 x1876025362380928/t4294967299(0) o4->e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp:14/0 lens 504/448 e 0 to 0 dl 1789117474 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789117463.509915:0:6690:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c17b87a1e00 with x1876025362380928 ext(0->12) 00010000:00010000:2.0:1789117463.509926:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000082aae0b7/0xf7565228e460dfac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d7 expref: 9 pid: 6685 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117463.509943:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000082aae0b7/0xf7565228e460dfac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d7 expref: 9 pid: 6685 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789117463.509951:0:6690:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c17b87a1e00 00000100:00100000:0.0:1789117463.517997:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117463.518222:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362381056 00000100:00100000:2.0:1789117463.518231:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362381056 00010000:00010000:2.0:1789117463.518270:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000082aae0b7/0xf7565228e460dfac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d7 expref: 9 pid: 6685 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117463.518507:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 41 00000100:00100000:2.0:1789117463.518518:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d79a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+9:2350:x1876025362381056:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117463.518534:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789117463.518553:0:7638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789117463.518556:0:7638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789117462 00002000:00010000:2.0:1789117463.518558:0:7638:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789117462 00002000:00010000:2.0:1789117463.518561:0:7638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789117462 00010000:00010000:2.0:1789117463.518567:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000082aae0b7/0xf7565228e460dfac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d7 expref: 9 pid: 6685 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117463.518582:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000082aae0b7/0xf7565228e460dfac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d7 expref: 9 pid: 6685 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117463.518606:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082aae0b7/0xf7565228e460dfac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7d7 expref: 9 pid: 6685 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117463.518623:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789117463.518628:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789117463.518634:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001c7c01f9/0xf7565228e460dff9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117463.518643:0:7638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c7c01f9/0xf7565228e460dff9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117463.518682:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117463.518746:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d79a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+8:2350:x1876025362381056:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 231us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117463.518754:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 41 00010000:00010000:0.0:1789117463.521794:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001c7c01f9/0xf7565228e460dff9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.521812:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c7c01f9/0xf7565228e460dff9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.521845:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c7c01f9/0xf7565228e460dff9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.521852:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c7c01f9/0xf7565228e460dff9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.521873:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c7c01f9/0xf7565228e460dff9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.521881:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442fe00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:0.0:1789117463.521886:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c7c01f9/0xf7565228e460dff9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.521894:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c7c01f9/0xf7565228e460dff9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.521910:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c7c01f9/0xf7565228e460dff9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.521917:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c7c01f9/0xf7565228e460dff9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117463.522014:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+7:2352:x1876025362380800:12345-192.168.206.37@tcp:1:lfs.0 Request processed in 61557us (61736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117463.522023:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 23 00000100:00100000:0.0:1789117463.524270:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117463.524391:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362381312 00000100:00100000:1.0:1789117463.524433:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362381312 00000100:00100000:1.0:1789117463.524476:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 8 00000100:00100000:1.0:1789117463.524486:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+19:10515:x1876025362381312:12345-192.168.206.37@tcp:35:lfs.0 00000004:00010000:1.0:1789117463.524547:0:5843:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460dfeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7f3 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789117463.524916:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1789117463.524973:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1789117463.525916:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1789117463.525989:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e000 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.526007:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460df90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7c9 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.526015:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e000 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.526331:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460df90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7c9 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.526563:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460df90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7c9 expref: 23 pid: 5839 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117463.526648:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0141e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5843:1876025385483904:192.168.206.37@tcp:104: 00000100:00100000:1.0:1789117463.526718:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a9764e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789117463.528950:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0141e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5843:1876025385483904:192.168.206.37@tcp:104: 00010000:00010000:1.0:1789117463.528975:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e000 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117463.534595:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117463.535245:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362381440 00000100:00100000:3.0:1789117463.535305:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362381440 00010000:00010000:3.0:1789117463.535638:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460df90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7c9 expref: 24 pid: 5839 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117463.535761:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 42 00000100:00100000:0.0:1789117463.535774:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+24:2349:x1876025362381440:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117463.535788:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117463.535809:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460df90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7c9 expref: 24 pid: 5839 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.535823:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460df90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7c9 expref: 24 pid: 5839 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.535844:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460df90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7c9 expref: 24 pid: 5839 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.535860:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9ea00) 00010000:00010000:0.0:1789117463.535865:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e000 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.535874:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e000 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.535881:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e000 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.535910:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117463.535968:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+23:2349:x1876025362381440:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 190us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117463.535976:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 42 00010000:00010000:1.0:1789117463.536593:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e000 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.536603:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e000 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789117463.536717:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1789117463.536899:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1789117463.537204:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0141e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1876025385484032:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789117463.537301:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117463.537392:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a9764600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117463.539334:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385484032 00000100:00100000:3.0:1789117463.539625:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385484032 00000100:00100000:2.0:1789117463.539851:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789117463.539862:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0142d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1876025385484032:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789117463.540089:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0142d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1876025385484032:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 228us (2787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117463.540097:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789117463.540276:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0141e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1876025385484032:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789117463.541706:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1789117463.541785:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0141e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1876025385484160:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789117463.541830:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117463.541904:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a9764e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789117463.541941:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385484160 00000100:00100000:3.0:1789117463.541946:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385484160 00000100:00100000:3.0:1789117463.542241:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789117463.542251:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1876025385484160:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789117463.542804:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1876025385484160:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 553us (971us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789117463.542812:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789117463.542886:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0141e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1876025385484160:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789117463.542939:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1789117463.542989:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e000 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.543000:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e000 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.543018:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e000 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.543024:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442fa00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117463.543028:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e000 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.543054:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e000 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.543069:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9ea00) 00010000:00010000:0.0:1789117463.543072:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789117463.543076:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e000 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.543082:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e000 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789117463.543248:0:5843:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789117463.543507:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789117463.543518:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 310673117276ns, next at 311673115114ns, rc = 0 00000001:00080000:0.0:1789117463.543524:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1789117463.543555:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9ea00) 00010000:00010000:0.0:1789117463.543559:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789117463.543575:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460dfeb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7f3 expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117463.543671:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+26:10515:x1876025362381312:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 19185us (19407us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789117463.543690:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 8 00000020:00080000:0.0:1789117463.543694:0:5843:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789117463.546112:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117463.546230:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362381568 00000100:00100000:1.0:1789117463.546239:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362381568 00000100:00100000:1.0:1789117463.546290:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 45 00000100:00100000:1.0:1789117463.546300:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+26:10515:x1876025362381568:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117463.546321:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117463.546341:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e007 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c7fa expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.546438:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e007 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7fa expref: 27 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.546453:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e007 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7fa expref: 27 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.546472:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:1.0:1789117463.546475:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789117463.546479:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e200, rc 0) 00000100:00100000:1.0:1789117463.546534:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+27:10515:x1876025362381568:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 235us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117463.546541:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 45 00000100:00100000:3.0:1789117463.551896:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117463.551996:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362381824 00000100:00100000:0.0:1789117463.552005:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362381824 00000100:00100000:0.0:1789117463.552179:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 9 00000100:00100000:0.0:1789117463.552191:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a9736050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+27:10515:x1876025362381824:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:0.0:1789117463.552457:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a9736050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+28:10515:x1876025362381824:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 269us (569us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1789117463.552466:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 9 00000100:00100000:3.0:1789117463.649925:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117463.649999:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362382080 00000100:00100000:1.0:1789117463.650018:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362382080 00000100:00100000:1.0:1789117463.650089:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 46 00000100:00100000:1.0:1789117463.650099:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+28:10525:x1876025362382080:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117463.650133:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117463.650152:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e00e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c801 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117463.650294:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1789117463.652661:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e00e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c801 expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.652683:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9ef00) 00010000:00010000:1.0:1789117463.652686:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789117463.652691:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e00e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c801 expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.652709:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442ec00, rc 0) 00000100:00100000:2.0:1789117463.652894:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+29:10525:x1876025362382080:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 2794us (2974us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1789117463.652903:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 46 00000100:00100000:3.0:1789117463.657117:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117463.657213:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362382208 00000100:00100000:1.0:1789117463.657222:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362382208 00000100:00100000:1.0:1789117463.657277:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 47 00000100:00100000:1.0:1789117463.657287:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168395a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+29:10525:x1876025362382208:12345-192.168.206.37@tcp:34:lfs.0 00010000:00010000:1.0:1789117463.657358:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e01c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657374:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e01c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657385:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e01c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657453:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e023 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657462:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e023 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657469:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e023 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657561:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e02a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657570:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e02a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657577:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e02a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789117463.657621:0:7242:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e02a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657633:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e01c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657638:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e01c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657645:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e01c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657651:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442f000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117463.657655:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e01c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657669:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e01c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657681:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:1.0:1789117463.657683:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117463.657688:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e01c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657694:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e01c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657708:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e023 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657715:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e023 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657720:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e023 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657725:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ea00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117463.657728:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e023 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657734:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e023 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657741:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c1788d9e800) 00010000:00010000:1.0:1789117463.657744:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117463.657747:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e023 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657764:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e023 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657779:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e02a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657785:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e02a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657791:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e02a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657796:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117463.657799:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e02a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657804:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e02a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657810:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:1.0:1789117463.657812:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117463.657815:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e02a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.657821:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e02a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117463.657888:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168395a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+29:10525:x1876025362382208:12345-192.168.206.37@tcp:34:lfs.0 Request processed in 602us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117463.657896:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 47 00000100:00100000:3.0:1789117463.660551:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117463.660807:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362382464 00000100:00100000:0.0:1789117463.660817:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362382464 00000100:00100000:0.0:1789117463.660911:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 10 00000100:00100000:0.0:1789117463.660921:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1683959e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+29:10525:x1876025362382464:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:0.0:1789117463.661180:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1683959e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+30:10525:x1876025362382464:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 259us (635us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789117463.661187:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 10 00000100:00100000:3.0:1789117463.709874:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117463.710152:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362382720 00000100:00100000:0.0:1789117463.710161:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362382720 00000100:00100000:0.0:1789117463.710281:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 48 00000100:00100000:0.0:1789117463.710292:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168395a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+30:10528:x1876025362382720:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:0.0:1789117463.710327:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117463.710349:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e031 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c808 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710567:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e038 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710581:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e038 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710592:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e038 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710606:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e03f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710613:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e03f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710619:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e03f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710744:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e046 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710753:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710760:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117463.710770:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789117463.710859:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e038 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710866:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e038 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710879:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e038 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710884:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbdc00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117463.710888:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e038 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710895:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e038 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710906:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:0.0:1789117463.710909:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117463.710914:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e038 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710920:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e038 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710931:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e03f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710937:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e03f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710943:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e03f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710948:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117463.710951:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e03f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710967:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e03f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710975:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c1782c0e000) 00010000:00010000:0.0:1789117463.710977:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117463.710981:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e03f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.710986:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e03f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.711029:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e031 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c808 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.711054:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e046 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c808 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117463.711062:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:0.0:1789117463.711064:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117463.711066:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbcc00, rc 0) 00000100:00100000:0.0:1789117463.711245:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168395a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+32:10528:x1876025362382720:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 954us (1379us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1789117463.711253:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 48 00000100:00100000:3.0:1789117463.714218:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117463.714371:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362382848 00000100:00100000:1.0:1789117463.714380:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362382848 00000100:00100000:1.0:1789117463.714600:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 49 00000100:00100000:1.0:1789117463.714611:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+32:10528:x1876025362382848:12345-192.168.206.37@tcp:54:lfs.0 00010000:00010000:1.0:1789117463.714669:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e054 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.714684:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.714695:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.714717:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.714724:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e054 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.714731:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e054 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.714737:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117463.714741:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e054 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.714749:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e054 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.714775:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:1.0:1789117463.714778:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789117463.714783:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e054 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117463.714802:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e054 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117463.714876:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+32:10528:x1876025362382848:12345-192.168.206.37@tcp:54:lfs.0 Request processed in 267us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117463.714884:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 49 00000100:00100000:3.0:1789117463.718855:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117463.719795:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362383104 00000100:00100000:0.0:1789117463.719806:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362383104 00000100:00100000:0.0:1789117463.719864:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 11 00000100:00100000:0.0:1789117463.719874:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+32:10528:x1876025362383104:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:0.0:1789117463.720132:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+33:10528:x1876025362383104:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 257us (1283us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789117463.720141:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 11 00000100:00100000:3.0:1789117464.055329:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117464.055395:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362383360 00000100:00100000:2.0:1789117464.055422:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362383360 00000100:00100000:2.0:1789117464.055503:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 50 00000100:00100000:2.0:1789117464.055516:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+33:10559:x1876025362383360:12345-192.168.206.37@tcp:101:cat.0 00010000:00010000:2.0:1789117464.055537:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117464.055556:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e05b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c80f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.055643:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e062 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.055658:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.055671:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117464.055787:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789117464.055924:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e05b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c80f expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.055942:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e062 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c80f expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.055950:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:2.0:1789117464.055953:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117464.055956:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457ec00, rc 0) 00000100:00080000:3.0:1789117464.056089:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117464.056158:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+35:10559:x1876025362383360:12345-192.168.206.37@tcp:101:cat.0 Request processed in 645us (2184us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789117464.056165:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 50 00000100:00100000:0.0:1789117464.068752:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117464.068849:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362383488 00000100:00100000:1.0:1789117464.068858:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362383488 00000100:00100000:1.0:1789117464.068921:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 3 00000100:00100000:1.0:1789117464.068931:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d7a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+35:2352:x1876025362383488:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117464.068946:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117464.068973:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e062 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c80f expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.068991:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:1.0:1789117464.068996:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117464.069064:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d7a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+34:2352:x1876025362383488:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 134us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117464.069072:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 3 00000100:00100000:0.0:1789117464.073769:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117464.073845:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362383744 00000100:00100000:1.0:1789117464.073854:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362383744 00000100:00100000:1.0:1789117464.073908:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 12 00000100:00100000:1.0:1789117464.073917:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+34:10559:x1876025362383744:12345-192.168.206.37@tcp:35:cat.0 00000100:00100000:1.0:1789117464.074142:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+35:10559:x1876025362383744:12345-192.168.206.37@tcp:35:cat.0 Request processed in 225us (379us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789117464.074151:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 12 00000100:00100000:2.0:1789117464.134928:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117464.135010:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362384000 00000100:00100000:1.0:1789117464.135020:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362384000 00000100:00100000:1.0:1789117464.135085:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 51 00000100:00100000:1.0:1789117464.135095:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+35:10565:x1876025362384000:12345-192.168.206.37@tcp:101:dd.0 00010000:00010000:1.0:1789117464.135289:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117464.135292:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789117464.135331:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460dfc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7e5 expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.135348:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:1.0:1789117464.135353:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789117464.135365:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e070 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c816 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.135489:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e077 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.135502:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e046 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c808 expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.135511:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e077 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.135541:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e046 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c808 expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.135554:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e046 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c808 expref: 35 pid: 5840 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117464.135584:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0141a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876025385484288:192.168.206.37@tcp:104: 00000100:00100000:1.0:1789117464.135681:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a9764e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789117464.140881:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117464.140971:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362384128 00000100:00100000:2.0:1789117464.140980:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362384128 00000100:00100000:1.0:1789117464.141006:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0141a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876025385484288:192.168.206.37@tcp:104: 00010000:00010000:2.0:1789117464.141024:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e046 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c808 expref: 36 pid: 5840 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.141028:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e077 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117464.141070:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 43 00000100:00100000:2.0:1789117464.141079:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+36:2350:x1876025362384128:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117464.141093:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117464.141099:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e046 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c808 expref: 36 pid: 5840 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.141112:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e046 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c808 expref: 36 pid: 5840 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.141146:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e046 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c808 expref: 36 pid: 5840 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.141161:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:2.0:1789117464.141166:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e077 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.141175:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e077 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.141183:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e077 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.141207:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117464.141257:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+35:2350:x1876025362384128:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 178us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117464.141264:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 43 00010000:00010000:1.0:1789117464.141999:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e077 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.142009:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e077 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117464.142026:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789117464.142194:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e070 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c816 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.142211:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e077 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c816 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.142219:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:1.0:1789117464.142222:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789117464.142225:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442ea00, rc 0) 00000100:00100000:1.0:1789117464.142270:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+35:10565:x1876025362384000:12345-192.168.206.37@tcp:101:dd.0 Request processed in 7176us (7351us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789117464.142277:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 51 00000100:00100000:0.0:1789117464.149821:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117464.149902:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362384384 00000100:00100000:2.0:1789117464.149911:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362384384 00000100:00100000:2.0:1789117464.149967:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 52 00000100:00100000:2.0:1789117464.149978:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+35:10565:x1876025362384384:12345-192.168.206.37@tcp:36:dd.0 00010000:00010000:2.0:1789117464.150237:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e085 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.150254:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.150265:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789117464.150335:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1789117464.150370:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c082027b reply state 00000000398c3a46 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117464.150379:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789117464.150487:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+38:10565:x1876025362384384:12345-192.168.206.37@tcp:36:dd.0 Request processed in 510us (673us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789117464.150495:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 52 00000020:00080000:2.0:1789117464.150499:0:5840:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789117464.156028:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117464.156072:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e085 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117464.156079:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e085 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117464.156085:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117464.156090:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e085 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117464.156098:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e085 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117464.156114:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:3.0:1789117464.156116:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117464.156121:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e085 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117464.156126:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e085 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117464.389564:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117464.468032:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117464.468242:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362384512 00000100:00100000:2.0:1789117464.468251:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362384512 00000100:00100000:2.0:1789117464.468324:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 53 00000100:00100000:2.0:1789117464.468334:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+37:10579:x1876025362384512:12345-192.168.206.37@tcp:101:stat.0 00010000:00010000:2.0:1789117464.468367:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117464.468385:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e08c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c81d expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.468472:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e093 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.468486:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e093 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.468497:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e093 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.468510:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e09a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.468534:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e09a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.468542:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e09a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.468630:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.468641:0:7242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e077 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c816 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.468649:0:7242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0a1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.468683:0:7242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e077 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c816 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.468696:0:7242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e077 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c816 expref: 38 pid: 5841 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117464.468709:0:7242:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7242:1876025385484416:192.168.206.37@tcp:104: 00000100:00100000:2.0:1789117464.469323:0:7242:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c1d966c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117464.474662:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117464.474759:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362384768 00000100:00100000:1.0:1789117464.474781:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362384768 00000100:00100000:1.0:1789117464.474841:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 13 00000100:00100000:1.0:1789117464.474851:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+39:5602:x1876025362384768:12345-192.168.206.37@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789117464.475188:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+40:5602:x1876025362384768:12345-192.168.206.37@tcp:35:ldlm_bl.0 Request processed in 338us (534us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1789117464.475196:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 13 00000100:00100000:0.0:1789117464.478749:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117464.479310:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362384896 00000100:00100000:1.0:1789117464.479338:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362384896 00010000:00010000:1.0:1789117464.479388:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e077 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c816 expref: 40 pid: 5841 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117464.479463:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 44 00000100:00100000:1.0:1789117464.479473:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17845e2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+40:2349:x1876025362384896:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117464.479486:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117464.479494:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e077 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c816 expref: 40 pid: 5841 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.479506:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e077 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c816 expref: 40 pid: 5841 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.479527:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:1.0:1789117464.479533:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.479542:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.479549:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0a1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.479581:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117464.479634:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17845e2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+40:2349:x1876025362384896:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 162us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117464.479641:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 44 00010000:00010000:2.0:1789117464.480953:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e077 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c816 expref: 39 pid: 5841 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117464.480974:0:7242:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7242:1876025385484416:192.168.206.37@tcp:104: 00010000:00010000:2.0:1789117464.480996:0:7242:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.481028:0:7242:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.481034:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117464.481082:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789117464.481086:0:7242:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789117464.481131:0:7242:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.481144:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.481153:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e093 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.481159:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e093 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.481166:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e093 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.481171:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117464.481175:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e093 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.481182:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e093 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.481193:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:2.0:1789117464.481201:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117464.481206:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e093 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.481212:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e093 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.481223:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e09a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.481229:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e09a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.481235:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e09a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.481240:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117464.481243:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e09a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.481249:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e09a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.481257:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c1783e89f00) 00010000:00010000:2.0:1789117464.481259:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117464.481262:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e09a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.481268:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e09a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.481309:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e08c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c81d expref: 39 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.481347:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c81d expref: 38 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.481354:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:2.0:1789117464.481365:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117464.481368:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457ec00, rc 0) 00000100:00100000:2.0:1789117464.481455:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+38:10579:x1876025362384512:12345-192.168.206.37@tcp:101:stat.0 Request processed in 13121us (13431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117464.481463:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 53 00000100:00100000:3.0:1789117464.561507:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117464.561720:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362385152 00000100:00100000:2.0:1789117464.561729:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362385152 00000100:00100000:2.0:1789117464.561793:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 54 00000100:00100000:2.0:1789117464.561804:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+38:10585:x1876025362385152:12345-192.168.206.37@tcp:36:truncate.0 00010000:00010000:2.0:1789117464.561872:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117464.561895:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c81d expref: 38 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.561911:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:2.0:1789117464.561916:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117464.562136:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.562150:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.562158:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789117464.562216:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1789117464.562241:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009904a436 reply state 000000007af378a0 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117464.562250:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789117464.562357:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+40:10585:x1876025362385152:12345-192.168.206.37@tcp:36:truncate.0 Request processed in 554us (857us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789117464.562364:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 54 00000020:00080000:2.0:1789117464.562369:0:5840:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789117464.572503:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.572531:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.572540:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.572546:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117464.572550:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.572558:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.572585:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:2.0:1789117464.572588:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117464.572594:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.572600:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117464.741581:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117464.741815:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362385280 00000100:00100000:1.0:1789117464.741825:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362385280 00000100:00100000:1.0:1789117464.741883:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 55 00000100:00100000:1.0:1789117464.741894:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+39:10599:x1876025362385280:12345-192.168.206.37@tcp:101:stat.0 00010000:00010000:1.0:1789117464.741917:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117464.741936:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e0af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c824 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.741994:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e0b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742021:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e0b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742031:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e0b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742060:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742067:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742074:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742189:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e0c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742198:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742205:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117464.742235:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1789117464.742240:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789117464.742259:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742269:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742278:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e0b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742284:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e0b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742290:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e0b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742297:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117464.742301:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e0b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742309:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e0b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742326:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:1.0:1789117464.742328:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117464.742333:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e0b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742339:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e0b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742354:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742360:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742366:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742371:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442f000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117464.742373:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742379:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742387:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c1788d9e800) 00010000:00010000:1.0:1789117464.742390:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117464.742393:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742458:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742499:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e0af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c824 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742512:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e0c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c824 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.742530:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:1.0:1789117464.742532:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117464.742535:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442ea00, rc 0) 00000100:00100000:1.0:1789117464.742595:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+40:10599:x1876025362385280:12345-192.168.206.37@tcp:101:stat.0 Request processed in 703us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117464.742602:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 55 00000100:00100000:1.0:1789117464.831625:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117464.831716:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362385536 00000100:00100000:2.0:1789117464.831726:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362385536 00000100:00100000:2.0:1789117464.831781:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 56 00000100:00100000:2.0:1789117464.831799:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0141a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+40:10609:x1876025362385536:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:2.0:1789117464.831819:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117464.831839:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c82b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117464.831943:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1789117464.832063:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0cb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c82b expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.832076:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9ef00) 00010000:00010000:2.0:1789117464.832080:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789117464.832084:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c82b expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.832107:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457e600, rc 0) 00000100:00100000:2.0:1789117464.832168:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0141a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+41:10609:x1876025362385536:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 377us (552us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1789117464.832176:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 56 00000100:00100000:0.0:1789117464.835777:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117464.836282:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362385792 00000100:00100000:1.0:1789117464.836292:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362385792 00000100:00100000:1.0:1789117464.836349:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 14 00000100:00100000:1.0:1789117464.836369:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+41:10609:x1876025362385792:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:1.0:1789117464.838752:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+42:10609:x1876025362385792:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 2375us (2975us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789117464.838765:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 14 00000100:00100000:0.0:1789117464.891337:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117464.891888:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362386048 00000100:00100000:1.0:1789117464.891897:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362386048 00000100:00100000:1.0:1789117464.891942:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 57 00000100:00100000:1.0:1789117464.891950:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+42:10615:x1876025362386048:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:1.0:1789117464.891970:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117464.892000:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e0d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c832 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.892229:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.892241:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e0c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c824 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.892249:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0e0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.892278:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e0c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c824 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.892290:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e0c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c824 expref: 43 pid: 5841 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117464.892302:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0143480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876025385484544:192.168.206.37@tcp:104: 00000100:00100000:1.0:1789117464.892510:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1782cd8000 going to sleep for 11 seconds 00000100:00100000:3.0:1789117464.896250:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117464.896313:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362386176 00000100:00100000:2.0:1789117464.896321:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362386176 00010000:00010000:2.0:1789117464.896360:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e0c4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c824 expref: 44 pid: 5841 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117464.896485:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0143480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876025385484544:192.168.206.37@tcp:104: 00010000:00010000:1.0:1789117464.896508:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117464.896620:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 45 00000100:00100000:2.0:1789117464.896642:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+44:2349:x1876025362386176:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117464.896668:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117464.896675:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e0c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c824 expref: 44 pid: 5841 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.896688:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e0c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c824 expref: 44 pid: 5841 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.896712:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e0c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c824 expref: 44 pid: 5841 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.896730:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:2.0:1789117464.896734:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.896743:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.896750:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0e0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.896786:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117464.896839:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+43:2349:x1876025362386176:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 199us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117464.896848:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 45 00010000:00010000:1.0:1789117464.896898:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.896906:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117464.896933:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1789117464.897071:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e0d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c832 expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.897086:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c832 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.897094:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:1.0:1789117464.897096:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789117464.897099:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442f000, rc 0) 00000100:00100000:1.0:1789117464.897124:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+43:10615:x1876025362386048:12345-192.168.206.37@tcp:101:bash.0 Request processed in 5174us (5795us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1789117464.897131:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 57 00000100:00100000:0.0:1789117464.911381:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117464.913033:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362386432 00000100:00100000:2.0:1789117464.913056:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362386432 00000100:00100000:2.0:1789117464.913115:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 58 00000100:00100000:2.0:1789117464.913125:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+43:10615:x1876025362386432:12345-192.168.206.37@tcp:36:bash.0 00010000:00010000:2.0:1789117464.913380:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.913396:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.913424:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789117464.913475:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1789117464.913500:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004c0de13b reply state 00000000a65b3e7c transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117464.913509:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789117464.913807:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+46:10615:x1876025362386432:12345-192.168.206.37@tcp:36:bash.0 Request processed in 682us (2434us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789117464.913815:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 58 00000020:00080000:2.0:1789117464.913820:0:5840:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789117464.919802:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.919818:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.919826:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.919832:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117464.919838:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.919845:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.919873:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:2.0:1789117464.919876:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117464.919880:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.919886:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117464.943948:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117464.950720:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362386560 00000100:00100000:2.0:1789117464.950733:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362386560 00000100:00100000:2.0:1789117464.950806:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 59 00000100:00100000:2.0:1789117464.950818:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+45:10615:x1876025362386560:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:2.0:1789117464.950840:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117464.950860:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c839 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.950932:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.950946:0:7242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0e0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c832 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.950956:0:7242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0fc lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.950988:0:7242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c832 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.951002:0:7242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c832 expref: 46 pid: 5841 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117464.951027:0:7242:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7242:1876025385484672:192.168.206.37@tcp:104: 00000100:00100000:2.0:1789117464.951118:0:7242:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c1d96240 going to sleep for 11 seconds 00000100:00100000:2.0:1789117464.954821:0:7242:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7242:1876025385484672:192.168.206.37@tcp:104: 00010000:00010000:2.0:1789117464.954847:0:7242:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117464.955923:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117464.956276:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362386688 00000100:00100000:2.0:1789117464.956283:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362386688 00010000:00010000:2.0:1789117464.956318:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c832 expref: 47 pid: 5841 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117464.956358:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 46 00000100:00100000:2.0:1789117464.956368:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0141680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+47:2349:x1876025362386688:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117464.956380:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117464.956387:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c832 expref: 47 pid: 5841 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.956433:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c832 expref: 47 pid: 5841 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.956454:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e0e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c832 expref: 47 pid: 5841 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.956471:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:2.0:1789117464.956476:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.956499:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.956507:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0fc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117464.956536:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117464.956656:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0141680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+46:2349:x1876025362386688:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 288us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117464.956663:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 46 00010000:00010000:1.0:1789117464.956831:0:7242:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.956839:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117464.956878:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789117464.956882:0:7242:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789117464.956898:0:7242:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.956922:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e0f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c839 expref: 46 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.956947:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c839 expref: 45 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117464.956954:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:1.0:1789117464.956957:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117464.956959:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457ec00, rc 0) 00000100:00100000:1.0:1789117464.956982:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+45:10615:x1876025362386560:12345-192.168.206.37@tcp:101:bash.0 Request processed in 6168us (13044us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117464.956988:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 59 00000100:00100000:3.0:1789117464.964264:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117464.967738:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362386944 00000100:00100000:0.0:1789117464.967751:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362386944 00000100:00100000:0.0:1789117464.967868:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 15 00000100:00100000:0.0:1789117464.967880:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a9736850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+45:10615:x1876025362386944:12345-192.168.206.37@tcp:35:bash.0 00000100:00100000:0.0:1789117464.968120:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a9736850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+46:10615:x1876025362386944:12345-192.168.206.37@tcp:35:bash.0 Request processed in 242us (3863us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1789117464.968128:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 15 00000100:00100000:0.0:1789117465.068345:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117465.068478:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362387200 00000100:00100000:3.0:1789117465.068487:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362387200 00000100:00100000:3.0:1789117465.068545:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 60 00000100:00100000:3.0:1789117465.068554:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+46:10625:x1876025362387200:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:3.0:1789117465.068606:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117465.068624:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e103 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c840 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117465.068725:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1789117465.068830:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e103 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c840 expref: 48 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.068843:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9ef00) 00010000:00010000:3.0:1789117465.068846:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789117465.068851:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e103 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c840 expref: 48 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.068865:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685400, rc 0) 00000100:00100000:3.0:1789117465.068976:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+47:10625:x1876025362387200:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 423us (640us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1789117465.068984:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 60 00000100:00100000:2.0:1789117465.075241:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117465.075332:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362387328 00000100:00100000:1.0:1789117465.075341:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362387328 00000100:00100000:1.0:1789117465.075435:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 61 00000100:00100000:1.0:1789117465.075445:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+47:10625:x1876025362387328:12345-192.168.206.37@tcp:34:lfs.0 00010000:00010000:1.0:1789117465.075510:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e111 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.075525:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e111 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.075537:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e111 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.075550:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e118 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.075557:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076017:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076239:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e11f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076249:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e11f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076256:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e11f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789117465.076295:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e11f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076307:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e111 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076314:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e111 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076320:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e111 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076326:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117465.076330:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e111 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076337:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e111 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076358:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:1.0:1789117465.076368:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117465.076373:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e111 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076379:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e111 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076393:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076475:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e118 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076483:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076488:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117465.076491:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076497:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e118 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076506:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c1788d9e800) 00010000:00010000:1.0:1789117465.076508:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117465.076511:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e118 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076516:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e118 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076530:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e11f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076542:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e11f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076548:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e11f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076553:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442fa00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117465.076556:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e11f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076577:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e11f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076586:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:1.0:1789117465.076588:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117465.076591:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e11f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.076597:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e11f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117465.076715:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+47:10625:x1876025362387328:12345-192.168.206.37@tcp:34:lfs.0 Request processed in 1270us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117465.076724:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 61 00000100:00100000:3.0:1789117465.087471:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117465.087850:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362387584 00000100:00100000:0.0:1789117465.087859:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362387584 00000100:00100000:0.0:1789117465.087916:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 16 00000100:00100000:0.0:1789117465.087926:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+47:10625:x1876025362387584:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:0.0:1789117465.088325:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+48:10625:x1876025362387584:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 398us (861us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1789117465.088333:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 16 00000100:00100000:0.0:1789117465.138062:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117465.138199:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362387840 00000100:00100000:3.0:1789117465.138207:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362387840 00000100:00100000:3.0:1789117465.138256:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 62 00000100:00100000:3.0:1789117465.138265:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+48:10628:x1876025362387840:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:3.0:1789117465.138288:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117465.138307:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e126 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c847 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138382:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e12d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138443:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e12d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138454:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e12d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138471:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e134 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138478:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138483:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138588:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e13b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138597:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e13b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138604:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e13b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117465.138612:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789117465.138701:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e12d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138708:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e12d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138714:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e12d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138727:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117465.138731:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e12d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138738:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e12d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138750:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:3.0:1789117465.138752:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117465.138756:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e12d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138771:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e12d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138784:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138790:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e134 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138795:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138800:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781684c00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117465.138803:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138809:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e134 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138828:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c1782df4e00) 00010000:00010000:3.0:1789117465.138830:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117465.138833:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e134 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138839:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e134 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138877:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e126 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c847 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138889:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e13b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c847 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.138895:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:3.0:1789117465.138897:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789117465.138900:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685200, rc 0) 00000100:00100000:3.0:1789117465.138962:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+50:10628:x1876025362387840:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 698us (908us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1789117465.138969:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 62 00000100:00100000:3.0:1789117465.146258:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117465.146303:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117465.146395:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362388096 00000100:00100000:0.0:1789117465.146425:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362388096 00000100:00100000:0.0:1789117465.146481:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 4 00000100:00100000:0.0:1789117465.146490:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+50:2351:x1876025362388096:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117465.146504:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117465.146526:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e13b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c847 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117465.146543:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:0.0:1789117465.146548:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117465.146617:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+49:2351:x1876025362388096:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 127us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117465.146624:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 4 00000100:00100000:2.0:1789117465.147124:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362387968 00000100:00100000:2.0:1789117465.147129:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362387968 00000100:00100000:2.0:1789117465.147167:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 63 00000100:00100000:2.0:1789117465.147176:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+49:10628:x1876025362387968:12345-192.168.206.37@tcp:54:lfs.0 00010000:00010000:2.0:1789117465.147224:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e149 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.147237:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.147247:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.147270:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.147276:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e149 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.147298:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e149 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.147303:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117465.147307:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e149 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.147315:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e149 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.147324:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:2.0:1789117465.147327:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789117465.147331:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e149 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.147337:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e149 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117465.147424:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+49:10628:x1876025362387968:12345-192.168.206.37@tcp:54:lfs.0 Request processed in 223us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117465.147432:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 63 00000100:00100000:3.0:1789117465.155008:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117465.155117:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362388352 00000100:00100000:0.0:1789117465.155127:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362388352 00000100:00100000:0.0:1789117465.155183:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 17 00000100:00100000:0.0:1789117465.155194:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+49:10628:x1876025362388352:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:0.0:1789117465.155439:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+50:10628:x1876025362388352:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 246us (449us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789117465.155447:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 17 00000100:00100000:3.0:1789117465.352046:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117465.352142:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362388608 00000100:00100000:2.0:1789117465.352152:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362388608 00000100:00100000:2.0:1789117465.352213:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 64 00000100:00100000:2.0:1789117465.352223:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+50:10646:x1876025362388608:12345-192.168.206.37@tcp:101:cat.0 00010000:00010000:2.0:1789117465.352246:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117465.352265:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e150 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c84e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.352375:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e157 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.352389:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e157 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.352439:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e157 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117465.352450:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789117465.352783:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e150 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c84e expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.352802:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e157 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c84e expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.352809:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:2.0:1789117465.352812:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789117465.352816:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457fa00, rc 0) 00000100:00100000:2.0:1789117465.352884:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+52:10646:x1876025362388608:12345-192.168.206.37@tcp:101:cat.0 Request processed in 662us (858us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789117465.352891:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 64 00000100:00100000:1.0:1789117465.375989:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117465.376085:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362388736 00000100:00100000:2.0:1789117465.376160:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362388736 00000100:00100000:2.0:1789117465.376215:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 65 00000100:00100000:2.0:1789117465.376224:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+52:10647:x1876025362388736:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:2.0:1789117465.376248:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117465.376279:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e165 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c855 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.376340:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e16c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.376469:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e16c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.376483:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e16c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117465.376542:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1789117465.376546:0:7242:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789117465.376567:0:7242:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e16c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.376749:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e165 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c855 expref: 54 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.376767:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e16c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c855 expref: 53 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.376775:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:2.0:1789117465.376778:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789117465.376782:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457e800, rc 0) 00000100:00100000:2.0:1789117465.376914:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+53:10647:x1876025362388736:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 690us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117465.376921:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 65 00000100:00100000:3.0:1789117465.389690:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117465.392503:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362389120 00000100:00100000:0.0:1789117465.392530:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362389120 00000100:00100000:0.0:1789117465.392595:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 18 00000100:00100000:0.0:1789117465.392606:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+53:10647:x1876025362389120:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:0.0:1789117465.393271:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+54:10647:x1876025362389120:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 664us (3587us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789117465.393280:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 18 00000100:00100000:3.0:1789117465.394929:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117465.397380:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362389248 00000100:00100000:2.0:1789117465.397422:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362389248 00000100:00100000:2.0:1789117465.397488:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 5 00000100:00100000:2.0:1789117465.397499:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+54:10647:x1876025362389248:12345-192.168.206.37@tcp:103:lfs.0 00010000:00010000:2.0:1789117465.397513:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789117465.397536:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e0fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c839 expref: 54 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.397557:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e157 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c84e expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.397570:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e007 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7fa expref: 52 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.397734:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1788d9e700) 00010000:00010000:2.0:1789117465.397746:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117465.397850:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+51:10647:x1876025362389248:12345-192.168.206.37@tcp:103:lfs.0 Request processed in 352us (2926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117465.397858:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 5 00000100:00100000:1.0:1789117465.401779:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117465.401901:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362389376 00000100:00100000:0.0:1789117465.401910:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362389376 00000100:00100000:0.0:1789117465.401964:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 66 00000100:00100000:0.0:1789117465.401975:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+51:10647:x1876025362389376:12345-192.168.206.37@tcp:58:lfs.0 00010000:00010000:0.0:1789117465.402246:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e173 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117465.402261:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e173 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117465.402272:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e173 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789117465.402578:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789117465.402947:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1789117465.403015:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1789117465.403283:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+51:10647:x1876025362389376:12345-192.168.206.37@tcp:58:lfs.0 Request processed in 1307us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117465.403292:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 66 00010000:00010000:0.0:1789117465.413810:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117465.440577:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117465.440944:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362389504 00000100:00100000:1.0:1789117465.440953:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362389504 00000100:00100000:1.0:1789117465.441013:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 67 00000100:00100000:1.0:1789117465.441022:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+51:10649:x1876025362389504:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117465.441063:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117465.441084:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e17a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c85c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441155:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e181 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441171:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e181 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441181:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e181 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441195:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e188 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441201:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441206:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441302:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e18f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441311:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e18f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441319:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e18f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117465.441504:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789117465.441515:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789117465.441536:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e18f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441547:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e18f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441555:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e181 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441561:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e181 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441567:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e181 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441573:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442fe00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117465.441576:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e181 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441592:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e181 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441604:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:1.0:1789117465.441607:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117465.441611:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e181 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441617:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e181 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441630:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441646:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e188 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441652:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e188 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441657:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117465.441659:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e188 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441665:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e188 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441673:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c1788d9e800) 00010000:00010000:1.0:1789117465.441675:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117465.441678:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e188 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441683:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e188 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441714:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e17a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c85c expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441727:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e18f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c85c expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.441733:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782c0e000) 00010000:00010000:1.0:1789117465.441735:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789117465.441743:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e200, rc 0) 00000100:00100000:1.0:1789117465.441809:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+52:10649:x1876025362389504:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 787us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117465.441817:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 67 00000040:00080000:2.0:1789117465.739861:0:12082:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789117465.739870:0:12082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789117465.739934:0:12082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789117465.739941:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789117465.740073:0:12082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87a2940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12082:1876025385484800:192.168.206.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789117465.740197:0:12082:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c1d96e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789117465.754512:0:12082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87a2940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12082:1876025385484800:192.168.206.37@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789117465.756298:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117465.757083:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362389632 00000100:00100000:3.0:1789117465.757293:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362389632 00000100:00100000:0.0:1789117465.766340:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 1 00000100:00100000:0.0:1789117465.766354:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e0c4e520-7af6-449d-969f-b46035974613+52:10660:x1876025362389632:12345-192.168.206.37@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789117465.766474:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e0c4e520-7af6-449d-969f-b46035974613+52:10660:x1876025362389632:12345-192.168.206.37@tcp:900:lhsmtool_posix.0 Request processed in 122us (10181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117465.766482:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 1 00000100:00100000:0.0:1789117465.772200:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117465.772338:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362389760 00000100:00100000:3.0:1789117465.772346:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362389760 00000100:00100000:3.0:1789117465.772419:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 68 00000100:00100000:3.0:1789117465.772429:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+52:10660:x1876025362389760:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789117465.772460:0:5839:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789117465.772550:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+52:10660:x1876025362389760:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 Request processed in 122us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117465.772558:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 68 00000100:00100000:3.0:1789117465.777380:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117465.777843:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362389888 00000100:00100000:1.0:1789117465.777853:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362389888 00000100:00100000:1.0:1789117465.777910:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 69 00000100:00100000:1.0:1789117465.777920:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+52:10660:x1876025362389888:12345-192.168.206.37@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789117465.777987:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e196 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778014:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e196 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778025:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e196 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778048:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e19d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778055:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e19d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778061:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e19d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778083:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e1a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778090:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778115:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117465.778149:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789117465.778154:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789117465.778166:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778177:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e196 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778184:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e196 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778191:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e196 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778196:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117465.778199:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e196 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778205:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e196 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778215:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1788d9e000) 00010000:00010000:1.0:1789117465.778217:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117465.778221:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e196 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778226:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e196 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778249:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e19d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778254:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e19d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778259:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e19d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778264:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442fe00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117465.778267:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e19d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778273:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e19d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778280:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9c1788d9e800) 00010000:00010000:1.0:1789117465.778283:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117465.778286:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e19d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778292:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e19d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778305:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778311:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e1a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778317:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778328:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e400 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117465.778330:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778336:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e1a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778343:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782c0e000) 00010000:00010000:1.0:1789117465.778345:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117465.778347:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e1a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117465.778353:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e1a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117465.778453:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+52:10660:x1876025362389888:12345-192.168.206.37@tcp:34:lhsmtool_posix.0 Request processed in 534us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117465.778460:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 69 00000100:00100000:0.0:1789117465.786697:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117465.786798:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362390144 00000100:00100000:3.0:1789117465.786808:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362390144 00000100:00100000:3.0:1789117465.786865:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 70 00000100:00100000:3.0:1789117465.786875:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+52:10660:x1876025362390144:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789117465.786894:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117465.786911:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e1ab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c863 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.787262:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.787276:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.787288:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117465.787315:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789117465.788163:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.788174:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.788181:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.788188:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685400 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117465.788192:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.788200:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.788213:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782c0e000) 00010000:00010000:3.0:1789117465.788216:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789117465.788221:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.788227:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.788276:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e1ab lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c863 expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.788287:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1788d9e000) 00010000:00010000:3.0:1789117465.788289:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789117465.788303:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e1ab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c863 expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.788314:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781684000, rc 0) 00000100:00100000:3.0:1789117465.789770:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+53:10660:x1876025362390144:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 2889us (3074us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1789117465.789781:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 70 00000100:00100000:0.0:1789117465.794903:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117465.794966:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362390272 00000100:00100000:2.0:1789117465.794976:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362390272 00000100:00100000:2.0:1789117465.795050:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 71 00000100:00100000:2.0:1789117465.795061:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+53:10660:x1876025362390272:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789117465.795106:0:5841:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789117465.795209:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+53:10660:x1876025362390272:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 Request processed in 150us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117465.795217:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 71 00000100:00100000:0.0:1789117465.801363:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117465.801481:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362390528 00000100:00100000:2.0:1789117465.801490:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362390528 00000100:00100000:2.0:1789117465.801547:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 72 00000100:00100000:2.0:1789117465.801558:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+53:10660:x1876025362390528:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117465.801576:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117465.801590:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789117465.801616:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e16c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c855 expref: 53 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.801633:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:2.0:1789117465.801639:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117465.801650:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e1c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c86a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789117465.802074:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789117465.802253:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e1c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.802266:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.802276:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e1c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.802335:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e1c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c86a expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.802349:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e1c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c86a expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.802356:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c1783e89f00) 00010000:00010000:2.0:1789117465.802359:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117465.802361:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f200, rc 0) 00000100:00100000:2.0:1789117465.802458:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+54:10660:x1876025362390528:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 902us (1110us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789117465.802465:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 72 00000100:00100000:0.0:1789117465.807319:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117465.807526:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362390784 00000100:00100000:2.0:1789117465.807535:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362390784 00000100:00100000:2.0:1789117465.807597:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 73 00000100:00100000:2.0:1789117465.807606:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+54:10660:x1876025362390784:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789117465.807827:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117465.807851:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e1c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c86a expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.807867:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c1783e89f00) 00010000:00010000:2.0:1789117465.807877:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117465.807897:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e1d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.807909:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e1d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.807927:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e1d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.807984:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e1dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf3ccfdaf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.808066:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e1dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf3ccfdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.808075:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e1dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf3ccfdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.808140:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e1d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.808146:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e1d5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.808152:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e1d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.808157:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117465.808161:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e1d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.808167:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e1d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.808175:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:2.0:1789117465.808178:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117465.808181:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e1d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.808191:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e1d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.808200:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e1dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf3ccfdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.808205:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e1dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf3ccfdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.808210:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e1dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf3ccfdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.808214:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117465.808216:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e1dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf3ccfdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.808222:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e1dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf3ccfdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.808229:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf3ccfdaf (ffff9c1783e89300) 00010000:00010000:2.0:1789117465.808232:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117465.808234:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e1dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf3ccfdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.808239:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e1dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf3ccfdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117465.808317:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+53:10660:x1876025362390784:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 Request processed in 711us (1004us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789117465.808324:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 73 00000100:00100000:0.0:1789117465.813675:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117465.814244:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362390912 00000100:00100000:3.0:1789117465.814255:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362390912 00000100:00100000:3.0:1789117465.814313:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 74 00000100:00100000:3.0:1789117465.814323:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+53:10660:x1876025362390912:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789117465.814343:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117465.814375:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e1e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c871 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.814427:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.814440:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.814452:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.814544:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e1e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c871 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.814563:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c871 expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.814581:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c1782df4e00) 00010000:00010000:3.0:1789117465.814584:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789117465.814587:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685400, rc 0) 00000100:00100000:3.0:1789117465.814646:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+54:10660:x1876025362390912:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 323us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117465.814653:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 74 00000100:00100000:0.0:1789117465.818930:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117465.819002:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362391168 00000100:00100000:3.0:1789117465.819011:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362391168 00000100:00100000:3.0:1789117465.819064:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 75 00000100:00100000:3.0:1789117465.819073:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+54:10660:x1876025362391168:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789117465.819199:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e1f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.819215:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.819226:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789117465.819722:0:7242:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1789117465.819731:0:7242:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 312949330522ns, next at 313949328517ns, rc = 0 00000004:00010000:0.0:1789117465.820958:0:7242:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000057d4612b reply state 00000000adb0f41f transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117465.820972:0:7242:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789117465.821112:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+56:10660:x1876025362391168:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 Request processed in 2038us (2188us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1789117465.821121:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 75 00010000:00010000:2.0:1789117465.823254:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.823278:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e1f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.823285:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e1f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.823290:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781684c00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117465.823295:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e1f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.823302:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e1f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.823317:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c1782df4e00) 00010000:00010000:2.0:1789117465.823320:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789117465.823324:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e1f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.823331:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e1f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117465.824801:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117465.824867:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362391296 00000100:00100000:3.0:1789117465.824877:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362391296 00000100:00100000:3.0:1789117465.824966:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 76 00000100:00100000:3.0:1789117465.824976:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+55:10660:x1876025362391296:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789117465.825002:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117465.825046:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e1f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c878 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.825110:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e1f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c878 expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.825124:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e1f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c878 expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.825142:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c1782df4e00) 00010000:00010000:3.0:1789117465.825146:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789117465.825149:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685600, rc 0) 00000100:00100000:3.0:1789117465.825205:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+56:10660:x1876025362391296:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 231us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117465.825212:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 76 00000100:00100000:2.0:1789117465.841118:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117465.841250:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362391424 00000100:00100000:1.0:1789117465.841271:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362391424 00000100:00100000:1.0:1789117465.841317:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 24 00000100:00100000:1.0:1789117465.841325:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1876025362391424:12345-192.168.206.37@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1789117465.841365:0:6687:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp t0 exp 0000000000000000 cur 312 last 0 00000020:00000080:1.0:1789117465.841393:0:6687:0:(genops.c:1385:class_connect()) connect: client e0c4e520-7af6-449d-969f-b46035974613, cookie 0xf7565228e460e1ff 00002000:00100000:1.0:1789117465.841439:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e0c4e520-7af6-449d-969f-b46035974613/ffff9c1787217000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789117465.841463:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789117465.841842:0:6687:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789117465.841881:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9c17c03a1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789117465.841947:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+6:2348:x1876025362391424:12345-192.168.206.37@tcp:8:lhsmtool_posix.0 Request processed in 621us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117465.841955:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 24 00000100:00100000:0.0:1789117465.862749:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117465.863973:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362391552 00000100:00100000:2.0:1789117465.863982:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362391552 00000100:00100000:2.0:1789117465.864046:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 25 00000100:00100000:2.0:1789117465.864056:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+6:0:x1876025362391552:12345-192.168.206.37@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789117465.864278:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1789117465.924744:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e0c4e520-7af6-449d-969f-b46035974613 00000001:00080000:0.0:1789117465.924774:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:2.0:1789117465.925225:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+5:0:x1876025362391552:12345-192.168.206.37@tcp:2:lhsmtool_posix.0 Request processed in 61165us (62476us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789117465.925247:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 25 00000100:00100000:0.0:1789117465.930918:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117465.932730:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362391808 00000100:00100000:1.0:1789117465.932742:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362391808 00000100:00100000:1.0:1789117465.932790:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 19 00000100:00100000:1.0:1789117465.932801:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+56:10660:x1876025362391808:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789117465.933012:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+57:10660:x1876025362391808:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 Request processed in 211us (2098us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789117465.933020:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 19 00000100:00100000:3.0:1789117465.939012:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117465.939054:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362392064 00000100:00100000:3.0:1789117465.939063:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362392064 00000100:00100000:3.0:1789117465.939115:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 77 00000100:00100000:3.0:1789117465.939124:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+57:10660:x1876025362392064:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789117465.939226:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+57:10660:x1876025362392064:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 Request processed in 103us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117465.939233:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 77 00000100:00100000:2.0:1789117465.952858:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117465.952934:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362392192 00000100:00100000:3.0:1789117465.952944:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362392192 00000100:00100000:3.0:1789117465.952996:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 78 00000100:00100000:3.0:1789117465.953006:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+57:10660:x1876025362392192:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789117465.953046:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117465.953066:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e206 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c87f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.953129:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e20d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.953142:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e20d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.953155:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e20d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117465.953188:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789117465.953206:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e20d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.953231:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e206 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c87f expref: 59 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.953246:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e20d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c87f expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.953255:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c1782df4e00) 00010000:00010000:3.0:1789117465.953258:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789117465.953262:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781684c00, rc 0) 00000100:00100000:3.0:1789117465.953515:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+58:10660:x1876025362392192:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 509us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117465.953523:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 78 00000100:00100000:0.0:1789117465.961969:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117465.962463:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362392320 00000100:00100000:2.0:1789117465.962472:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362392320 00000100:00100000:2.0:1789117465.962525:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 26 00000100:00100000:2.0:1789117465.962535:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1683959e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+5:2350:x1876025362392320:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117465.962553:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117465.962573:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4d12324/0xf7565228e460e214 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c886 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789117465.962608:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3c418, blocks: 0x1 00010000:00010000:2.0:1789117465.962626:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=313s v=(0 0) 00010000:00010000:2.0:1789117465.962631:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117465.962640:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4d12324/0xf7565228e460e214 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c886 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.962780:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f4d12324/0xf7565228e460e214 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c886 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117465.962795:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f600, rc 0) 00000100:00100000:2.0:1789117465.962850:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1683959e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+6:2350:x1876025362392320:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 317us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117465.962857:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 26 00000100:00100000:3.0:1789117465.965122:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117465.965192:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362392576 00000100:00100000:2.0:1789117465.965200:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362392576 00000100:00100000:2.0:1789117465.965260:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 79 00000100:00100000:2.0:1789117465.965270:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+58:10660:x1876025362392576:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789117465.965365:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+58:10660:x1876025362392576:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 Request processed in 96us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117465.965373:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 79 00000100:00100000:2.0:1789117465.975805:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117465.976487:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362392704 00000100:00100000:0.0:1789117465.976496:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362392704 00000100:00100000:0.0:1789117465.976590:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 27 00000100:00100000:0.0:1789117465.976601:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+6:10660:x1876025362392704:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117465.976626:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117465.976643:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054e49a21/0xf7565228e460e21b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c88d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117465.976741:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4d12324/0xf7565228e460e214 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c886 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117465.976751:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117465.976756:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117465.976761:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054e49a21/0xf7565228e460e21b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c88d expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117465.976805:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f4d12324/0xf7565228e460e214 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c886 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117465.976820:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f4d12324/0xf7565228e460e214 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c886 expref: 7 pid: 6687 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117465.976834:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f09e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1876025385484928:192.168.206.37@tcp:104: 00000100:00100000:0.0:1789117465.976910:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1782cd8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789117465.993193:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117465.993259:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362392832 00000100:00100000:3.0:1789117465.993268:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362392832 00010000:00010000:3.0:1789117465.993305:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f4d12324/0xf7565228e460e214 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c886 expref: 8 pid: 6687 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117465.993427:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f09e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1876025385484928:192.168.206.37@tcp:104: 00010000:00010000:0.0:1789117465.993454:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054e49a21/0xf7565228e460e21b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c88d expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117465.993472:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbc000, rc 0) 00000100:00100000:0.0:1789117465.993529:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+8:10660:x1876025362392704:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 16930us (17733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117465.993537:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 27 00000100:00100000:3.0:1789117465.994935:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 47 00000100:00100000:3.0:1789117465.994950:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+7:2349:x1876025362392832:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117465.994966:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117465.994989:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4d12324/0xf7565228e460e214 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c886 expref: 7 pid: 6687 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.995005:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4d12324/0xf7565228e460e214 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c886 expref: 7 pid: 6687 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.995026:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4d12324/0xf7565228e460e214 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c886 expref: 7 pid: 6687 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.995048:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117465.995052:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117465.995059:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054e49a21/0xf7565228e460e21b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c88d expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.995068:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054e49a21/0xf7565228e460e21b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c88d expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117465.995114:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000054e49a21/0xf7565228e460e21b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c88d expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117465.995127:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f0f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5825:1876025385485056:192.168.206.37@tcp:105: 00000100:00100000:3.0:1789117465.995191:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c0769b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789117465.999001:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117465.999145:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362392960 00000100:00100000:1.0:1789117465.999154:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362392960 00002000:00100000:1.0:1789117465.999195:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9c17b85c2d00 x1876025362392960/t0(0) o4->e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp:16/0 lens 504/0 e 0 to 0 dl 1789117476 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117465.999206:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c17b85c2d00 with x1876025362392960 ext(0->8) 00002000:00010000:1.0:1789117465.999210:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c17b85c2d00 00000100:00100000:1.0:1789117465.999235:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 0 00000100:00100000:1.0:1789117465.999243:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e0c4e520-7af6-449d-969f-b46035974613+7:2349:x1876025362392960:12345-192.168.206.37@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789117465.999885:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e0c4e520-7af6-449d-969f-b46035974613+9:2349:x1876025362392960:12345-192.168.206.37@tcp:4:lhsmtool_posix.0 Request processed in 640us (891us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789117465.999894:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 0 00002000:00100000:1.0:1789117465.999902:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9c17b85c2d00 x1876025362392960/t4294967302(0) o4->e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp:16/0 lens 504/448 e 0 to 0 dl 1789117476 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117465.999910:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c17b85c2d00 with x1876025362392960 ext(0->8) 00002000:00010000:1.0:1789117465.999919:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c17b85c2d00 00000100:00100000:3.0:1789117466.000209:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f0f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5825:1876025385485056:192.168.206.37@tcp:105: 00010000:00010000:3.0:1789117466.000227:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117466.000251:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+8:2349:x1876025362392832:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 5307us (7068us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117466.000259:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 47 00000100:00100000:3.0:1789117466.003363:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117466.003465:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362393088 00000100:00100000:2.0:1789117466.003474:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362393088 00000100:00100000:2.0:1789117466.003537:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 80 00000100:00100000:2.0:1789117466.003547:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+58:10660:x1876025362393088:12345-192.168.206.37@tcp:44:lhsmtool_posix.0 00000100:00080000:3.0:1789117466.003855:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117466.078604:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+58:10660:x1876025362393088:12345-192.168.206.37@tcp:44:lhsmtool_posix.0 Request processed in 75047us (75237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117466.078617:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 80 00000001:00080000:0.0:1789117466.078891:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:0.0:1789117466.078909:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789117466.078930:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:0.0:1789117466.078946:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c17a9764a80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1789117466.078950:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c178455b400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c1793030540 00000020:00080000:0.0:1789117466.078953:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c178455b900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c17b8bdcc00 00000004:00080000:0.0:1789117466.079007:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:0.0:1789117466.079139:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789117466.079154:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385485184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789117466.079203:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117466.079263:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385485184 00000100:00100000:0.0:1789117466.079270:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385485184 00000100:00100000:0.0:1789117466.079313:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789117466.079322:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385485184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789117466.079482:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789117466.079485:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789117465 00002000:00010000:0.0:1789117466.079488:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789117466.079490:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789117464 -> 1789117465 00002000:00010000:0.0:1789117466.079492:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789117466.079529:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1876025385485184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 208us (325us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789117466.079537:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:0.0:1789117466.079574:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c17b7f09e00/2, rc 0, transno 4294967303 00000100:00100000:0.0:1789117466.079579:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385485184:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1789117466.079880:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1789117466.079972:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00080000:3.0:1789117466.080164:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117466.080277:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385485312:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789117466.080313:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117466.080428:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385485312 00000100:00100000:2.0:1789117466.080434:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385485312 00000100:00100000:2.0:1789117466.080474:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789117466.080483:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1876025385485312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789117466.080500:0:8269:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1789117466.080527:0:8269:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa3c416, atime: 0x6aa3c416, ctime: 0x6aa3c416, blocks: 0x1 00010000:00010000:2.0:1789117466.080534:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5c7f598/0xf7565228e460e222 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.080547:0:8269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=313s v=(0 0) 00010000:00010000:2.0:1789117466.080551:0:8269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117466.080557:0:8269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5c7f598/0xf7565228e460e222 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.080590:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5c7f598/0xf7565228e460e222 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.080601:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5c7f598/0xf7565228e460e222 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.080608:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5c7f598/0xf7565228e460e222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.080623:0:8269:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1789117466.080775:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117466.081292:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3301:x1876025385485312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 809us (975us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789117466.081301:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1789117466.081374:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117466.081382:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5c7f598/0xf7565228e460e222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.081391:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e400 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:0.0:1789117466.081395:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5c7f598/0xf7565228e460e222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.081427:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5c7f598/0xf7565228e460e222 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.081443:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5c7f598/0xf7565228e460e222 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.081450:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5c7f598/0xf7565228e460e222 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.081468:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117466.081470:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117466.081471:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789117466.084904:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c17b7f0f840/2, rc 0, transno 4294967301 00000100:00100000:3.0:1789117466.084918:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385485312:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789117466.085150:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117466.085210:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362393216 00000100:00100000:0.0:1789117466.085217:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362393216 00000100:00100000:0.0:1789117466.085267:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 30 00000100:00100000:0.0:1789117466.085277:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+8:2349:x1876025362393216:12345-192.168.206.37@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789117466.131151:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1789117466.131169:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1789117466.131425:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+6:2349:x1876025362393216:12345-192.168.206.37@tcp:16:lhsmtool_posix.0 Request processed in 46116us (46244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117466.131437:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 30 00000100:00100000:0.0:1789117466.143253:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117466.143292:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362393472 00000100:00100000:0.0:1789117466.143301:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362393472 00000100:00100000:0.0:1789117466.143357:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 81 00000100:00100000:0.0:1789117466.143365:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+13:10660:x1876025362393472:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789117466.143430:0:7242:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117466.143455:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e20d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c87f expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.143471:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c1782df4e00) 00010000:00010000:0.0:1789117466.143476:0:7242:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117466.143504:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e229 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.143516:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e229 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.143525:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e229 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789117466.144394:0:7242:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000220f1d0d reply state 00000000210ef003 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e229 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117466.144429:0:7242:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789117466.144537:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+14:10660:x1876025362393472:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 Request processed in 1171us (1290us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789117466.144558:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 81 00000100:00100000:1.0:1789117466.147877:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00010000:00010000:1.0:1789117466.147908:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e229 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.147919:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e229 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.147927:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e229 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.147933:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbdc00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117466.147938:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e229 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.147945:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e229 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.147960:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c1782df4e00) 00010000:00010000:1.0:1789117466.147963:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117466.147968:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e229 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.147974:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e229 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117466.148016:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362393600 00000100:00100000:1.0:1789117466.148024:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362393600 00000100:00100000:1.0:1789117466.148078:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 31 00000100:00100000:1.0:1789117466.148095:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+6:2349:x1876025362393600:12345-192.168.206.37@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789117466.148337:0:8269:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789117466.148341:0:8269:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789117465 -> 1789117464 00002000:00010000:1.0:1789117466.148344:0:8269:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789117462 00002000:00010000:1.0:1789117466.148346:0:8269:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789117465 -> 1789117464 00002000:00010000:1.0:1789117466.148348:0:8269:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789117466.148418:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+7:2349:x1876025362393600:12345-192.168.206.37@tcp:2:lhsmtool_posix.0 Request processed in 304us (529us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789117466.148426:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 31 00000100:00100000:2.0:1789117466.159722:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117466.160762:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362393856 00000100:00100000:3.0:1789117466.160772:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362393856 00000100:00100000:3.0:1789117466.160818:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 82 00000100:00100000:3.0:1789117466.160826:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+13:10660:x1876025362393856:12345-192.168.206.37@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789117466.160884:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e230 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.160905:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c871 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.160915:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e230 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.160945:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c871 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.160958:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c871 expref: 13 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117466.160971:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0217840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876025385485440:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117466.161064:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1782dfd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117466.166019:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0217840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876025385485440:192.168.206.37@tcp:104: 00010000:00010000:0.0:1789117466.166066:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e230 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117466.179211:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117466.179555:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362393984 00000100:00100000:1.0:1789117466.179564:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362393984 00010000:00010000:1.0:1789117466.179611:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c871 expref: 14 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117466.179641:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 48 00000100:00100000:1.0:1789117466.179650:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+14:2349:x1876025362393984:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117466.179675:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117466.179682:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c871 expref: 14 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.179694:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c871 expref: 14 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.179715:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e1ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c871 expref: 14 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.179729:0:7638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c1782df4e00) 00010000:00010000:1.0:1789117466.179741:0:7638:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e230 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.179750:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e230 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.179756:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e230 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.179781:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117466.179829:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+13:2349:x1876025362393984:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 179us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117466.179836:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 48 00010000:00010000:1.0:1789117466.179860:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e230 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.179867:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e230 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.179891:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e230 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.179897:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e230 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.179903:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e230 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.179908:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117466.179912:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e230 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.179930:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e230 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.179939:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c1782df4e00) 00010000:00010000:1.0:1789117466.179942:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789117466.179946:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e230 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.179952:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e230 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117466.179999:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+12:10660:x1876025362393856:12345-192.168.206.37@tcp:55:lhsmtool_posix.0 Request processed in 19163us (20276us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789117466.180007:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 82 00000100:00100000:2.0:1789117466.184295:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117466.184372:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362394112 00000100:00100000:0.0:1789117466.184381:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362394112 00000100:00100000:0.0:1789117466.184449:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 32 00000100:00100000:0.0:1789117466.184460:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+7:2349:x1876025362394112:12345-192.168.206.37@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789117466.184502:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087698202/0xf7565228e460e237 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.184521:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054e49a21/0xf7565228e460e21b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c88d expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.184530:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117466.184534:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789117466.184539:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087698202/0xf7565228e460e237 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.184573:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000054e49a21/0xf7565228e460e21b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c88d expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.184600:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000054e49a21/0xf7565228e460e21b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c88d expref: 7 pid: 6686 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117466.184631:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f0b840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1876025385485568:192.168.206.37@tcp:104: 00000100:00100000:0.0:1789117466.184830:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f43cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117466.188831:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f0b840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1876025385485568:192.168.206.37@tcp:104: 00010000:00010000:0.0:1789117466.188861:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087698202/0xf7565228e460e237 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117466.189028:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117466.189515:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362394240 00000100:00100000:3.0:1789117466.189522:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362394240 00010000:00010000:3.0:1789117466.189557:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000054e49a21/0xf7565228e460e21b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c88d expref: 8 pid: 6686 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117466.189732:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 49 00000100:00100000:3.0:1789117466.189743:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17845e3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+8:2349:x1876025362394240:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117466.189827:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117466.189851:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000054e49a21/0xf7565228e460e21b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c88d expref: 8 pid: 6686 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.189865:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000054e49a21/0xf7565228e460e21b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c88d expref: 8 pid: 6686 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.189899:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054e49a21/0xf7565228e460e21b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c88d expref: 8 pid: 6686 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.189914:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789117466.189919:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789117466.189924:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087698202/0xf7565228e460e237 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.189934:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087698202/0xf7565228e460e237 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.189960:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117466.190024:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17845e3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+7:2349:x1876025362394240:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 282us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117466.190042:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 49 00010000:00010000:2.0:1789117466.191362:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087698202/0xf7565228e460e237 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.191380:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087698202/0xf7565228e460e237 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.191449:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087698202/0xf7565228e460e237 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.191477:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087698202/0xf7565228e460e237 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.191486:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087698202/0xf7565228e460e237 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.191494:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbca00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117466.191499:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087698202/0xf7565228e460e237 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.191509:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087698202/0xf7565228e460e237 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.191526:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087698202/0xf7565228e460e237 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.191534:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087698202/0xf7565228e460e237 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117466.191918:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2349:x1876025362394112:12345-192.168.206.37@tcp:1:lhsmtool_posix.0 Request processed in 7455us (7628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117466.191928:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 32 00000100:00100000:1.0:1789117466.204447:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117466.204494:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362394496 00000100:00100000:1.0:1789117466.204503:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362394496 00000100:00100000:1.0:1789117466.204560:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 83 00000100:00100000:1.0:1789117466.204570:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+12:10660:x1876025362394496:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789117466.204773:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e23e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.204789:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e23e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.204799:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e23e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.205551:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e245 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.205572:0:7242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e1f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c878 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.205724:0:7242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e245 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.205824:0:7242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e1f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c878 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.205840:0:7242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e1f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c878 expref: 13 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117466.205853:0:7242:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7242:1876025385485696:192.168.206.37@tcp:104: 00000100:00100000:1.0:1789117466.206339:0:7242:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1783ef99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117466.215802:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117466.218425:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362394624 00000100:00100000:3.0:1789117466.218437:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362394624 00010000:00010000:3.0:1789117466.218478:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e1f8 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c878 expref: 14 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117466.218514:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 50 00000100:00100000:3.0:1789117466.218522:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+14:2349:x1876025362394624:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117466.218536:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117466.218542:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e1f8 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c878 expref: 14 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.218568:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e1f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c878 expref: 14 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.218602:0:7638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c1782df4e00) 00010000:00010000:3.0:1789117466.218608:0:7638:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e245 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.218618:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e245 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.218625:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e245 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.218645:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117466.218709:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+14:2349:x1876025362394624:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 187us (2917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117466.218717:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 50 00010000:00010000:2.0:1789117466.220821:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e1f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c878 expref: 13 pid: 5839 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117466.220859:0:7242:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7242:1876025385485696:192.168.206.37@tcp:104: 00010000:00010000:2.0:1789117466.220882:0:7242:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e245 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.222807:0:7242:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e245 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.222821:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e245 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789117466.223003:0:7242:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1789117466.223155:0:7242:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1789117466.223200:0:7242:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1789117466.223312:0:7242:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f0a580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7242:1876025385485824:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789117466.224124:0:7242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117466.224203:0:7242:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f43a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789117466.227163:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385485824 00000100:00100000:2.0:1789117466.227177:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385485824 00000100:00100000:0.0:1789117466.227285:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789117466.227296:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7242:x1876025385485824:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789117466.227436:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7242:x1876025385485824:12345-0@lo:1000:mdt00_003.0 Request processed in 141us (3313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117466.227443:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789117466.229190:0:7242:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1789117466.229198:0:7242:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c17b7f09e00, transno 4294967303 00000100:00100000:1.0:1789117466.229224:0:7242:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f0a580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7242:1876025385485824:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789117466.229936:0:7242:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1789117466.230101:0:7242:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7242:1876025385485952:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789117466.230156:0:7242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117466.230192:0:7242:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b799a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789117466.230636:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385485952 00000100:00100000:0.0:1789117466.230649:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385485952 00000100:00100000:0.0:1789117466.230794:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789117466.230803:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178beca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7242:x1876025385485952:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789117466.231004:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178beca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7242:x1876025385485952:12345-0@lo:1000:mdt00_003.0 Request processed in 201us (847us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789117466.231012:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789117466.231106:0:7242:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7242:1876025385485952:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789117466.231140:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e245 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.231149:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e245 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.231165:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e245 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.231172:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117466.231176:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e245 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.231185:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e245 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.231200:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c1782df4e00) 00010000:00010000:1.0:1789117466.231203:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789117466.231208:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e245 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.231215:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e245 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.231251:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e173 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.231258:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e173 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.231278:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e173 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.231284:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbde00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117466.231287:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e173 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.231304:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e173 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.231313:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782c0e000) 00010000:00010000:1.0:1789117466.231315:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789117466.231319:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e173 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.231325:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e173 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.231377:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e24c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.231391:0:7242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e18f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c85c expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.231413:0:7242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e24c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.231439:0:7242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e18f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c85c expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.231452:0:7242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e18f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c85c expref: 16 pid: 5841 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117466.231464:0:7242:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b862ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7242:1876025385486080:192.168.206.37@tcp:104: 00000100:00100000:1.0:1789117466.231621:0:7242:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178720e480 going to sleep for 11 seconds 00000100:00100000:0.0:1789117466.239566:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117466.239610:0:7242:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b862ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7242:1876025385486080:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117466.239636:0:7242:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e24c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117466.239660:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362394752 00000100:00100000:3.0:1789117466.239665:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362394752 00010000:00010000:3.0:1789117466.239701:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e18f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c85c expref: 17 pid: 5841 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117466.239746:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 51 00000100:00100000:3.0:1789117466.239756:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+17:2349:x1876025362394752:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117466.239777:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117466.239784:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e18f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c85c expref: 17 pid: 5841 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.239797:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e18f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c85c expref: 17 pid: 5841 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.239819:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e18f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c85c expref: 17 pid: 5841 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.239833:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782c0e000) 00010000:00010000:3.0:1789117466.239838:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e24c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.239848:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e24c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.239856:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e24c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.239872:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117466.239925:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+16:2349:x1876025362394752:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 170us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117466.239935:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 51 00010000:00010000:3.0:1789117466.239958:0:7242:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e24c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.239965:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e24c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.239986:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e24c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.239993:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e24c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.240000:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e24c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.240005:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ec00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117466.240010:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e24c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.240017:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e24c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.240027:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782c0e000) 00010000:00010000:3.0:1789117466.240042:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117466.240046:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e24c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.240053:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e24c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.240065:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e23e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.240071:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e23e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.240078:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e23e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.240090:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ea00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117466.240094:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e23e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.240503:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e23e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.240516:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782c0e000) 00010000:00010000:3.0:1789117466.240519:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789117466.240523:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e23e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.240530:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e23e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117466.240738:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+15:10660:x1876025362394496:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 Request processed in 36169us (36302us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1789117466.240747:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 83 00000020:00080000:3.0:1789117466.240751:0:7242:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789117466.240912:0:12082:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789117466.240921:0:12082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789117466.240948:0:12082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789117466.240954:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789117466.244176:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117466.245162:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362395008 00000100:00100000:1.0:1789117466.245173:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362395008 00000100:00100000:1.0:1789117466.245233:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 20 00000100:00100000:1.0:1789117466.245245:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0216580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+15:10660:x1876025362395008:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789117466.246353:0:5842:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789117466.246493:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1789117466.248722:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e253 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.248743:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e253 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.248755:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e253 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.248763:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e253 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.248770:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e253 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.248777:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e253 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.249066:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789117466.249126:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117466.249134:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e253 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.249143:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd600 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:1.0:1789117466.249148:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e253 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.249157:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e253 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.249170:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c1782c0ef00) 00010000:00010000:1.0:1789117466.249173:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789117466.249178:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e253 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.249184:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e253 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.249201:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117466.249203:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117466.249204:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117466.249263:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0216580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+17:10660:x1876025362395008:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 Request processed in 4016us (5091us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789117466.249274:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 20 00000020:00080000:0.0:1789117466.249288:0:5842:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789117466.267019:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117466.267071:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117466.267103:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117466.267130:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362395392 00000100:00100000:3.0:1789117466.267138:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362395392 00000100:00100000:3.0:1789117466.267190:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 126 00000100:00100000:3.0:1789117466.267199:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362395392:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117466.267282:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362395392:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 83us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117466.267296:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362395264 00000100:00100000:3.0:1789117466.267300:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 126 00000100:00100000:1.0:1789117466.267303:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362395264 00000100:00080000:3.0:1789117466.267327:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789117466.267333:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117466.267347:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 68 00000100:00100000:1.0:1789117466.267356:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+7:2351:x1876025362395264:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117466.267386:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+7:2351:x1876025362395264:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 31us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117466.267394:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 68 00000100:00100000:2.0:1789117466.268143:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362395136 00000100:00100000:2.0:1789117466.268151:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362395136 00000100:00100000:2.0:1789117466.268226:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 308 00000100:00100000:2.0:1789117466.268285:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2351:x1876025362395136:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117466.268330:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2351:x1876025362395136:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 48us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117466.268338:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 308 00000040:00080000:0.0:1789117466.323105:0:12398:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789117466.323114:0:12398:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789117466.323152:0:12398:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789117466.323158:0:12398:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789117466.446372:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117466.465805:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117466.465889:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362395648 00000100:00100000:0.0:1789117466.465899:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362395648 00000100:00100000:0.0:1789117466.465972:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 84 00000100:00100000:0.0:1789117466.465982:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8628780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+17:10670:x1876025362395648:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:0.0:1789117466.466004:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117466.466023:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e25a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c894 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.466290:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460e261 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.466305:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460e261 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.466316:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460e261 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117466.466327:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1789117466.466669:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e25a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c894 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.466687:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460e261 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c894 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.466709:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:0.0:1789117466.466713:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789117466.466716:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbc600, rc 0) 00000100:00100000:0.0:1789117466.466778:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8628780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+19:10670:x1876025362395648:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 797us (982us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1789117466.466786:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 84 00000100:00100000:1.0:1789117466.470641:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117466.470698:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362395776 00000100:00100000:2.0:1789117466.470708:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362395776 00000100:00100000:2.0:1789117466.470765:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 85 00000100:00100000:2.0:1789117466.470774:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b862ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+19:10670:x1876025362395776:12345-192.168.206.37@tcp:34:lfs.0 00010000:00010000:2.0:1789117466.470841:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e26f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.470855:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e26f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.470866:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e26f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.470879:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e276 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.470909:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.470915:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.471778:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e27d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.471790:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e27d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.471799:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e27d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789117466.471840:0:5839:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e27d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.471853:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e26f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.471860:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e26f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.471866:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e26f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.471871:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457fa00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117466.471875:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e26f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.471882:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e26f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.471900:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:2.0:1789117466.471903:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117466.471907:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e26f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.471913:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e26f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.471923:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.471929:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e276 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.471935:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.471940:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117466.471943:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.471948:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e276 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.471955:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c1783e89300) 00010000:00010000:2.0:1789117466.471957:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117466.471959:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e276 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.471964:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e276 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.471988:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e27d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.471994:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e27d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.471999:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e27d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.472003:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117466.472006:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e27d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.472011:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e27d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.472018:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1783e89900) 00010000:00010000:2.0:1789117466.472021:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117466.472023:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e27d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.472041:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e27d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117466.472124:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b862ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+19:10670:x1876025362395776:12345-192.168.206.37@tcp:34:lfs.0 Request processed in 1349us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117466.472133:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 85 00000100:00100000:3.0:1789117466.554602:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117466.555180:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362396032 00000100:00100000:0.0:1789117466.555191:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362396032 00000100:00100000:0.0:1789117466.555253:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 86 00000100:00100000:0.0:1789117466.555264:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0215680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+19:10673:x1876025362396032:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:0.0:1789117466.555283:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117466.555302:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e284 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c89b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.555369:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460e28b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.555383:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460e28b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.555394:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460e28b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.555455:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e292 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.555463:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.555487:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.555787:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e299 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.555796:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.555803:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117466.555812:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789117466.556939:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460e28b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.556951:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460e28b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.556958:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460e28b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.556964:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbda00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117466.556969:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460e28b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.556976:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460e28b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.556990:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:0.0:1789117466.556993:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117466.557008:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460e28b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.557014:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460e28b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.557039:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.557045:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e292 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.557050:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e292 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.557055:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbce00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117466.557058:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e292 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.557127:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e292 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.557577:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c1782c0ea00) 00010000:00010000:0.0:1789117466.557581:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117466.557585:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e292 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.557592:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e292 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.557662:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e284 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c89b expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.558627:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e299 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c89b expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.558636:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782c0e700) 00010000:00010000:0.0:1789117466.558639:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117466.558643:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbc400, rc 0) 00000100:00100000:0.0:1789117466.558724:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0215680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+21:10673:x1876025362396032:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 3461us (4130us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1789117466.558733:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 86 00000100:00100000:1.0:1789117466.566592:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117466.566723:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362396160 00000100:00100000:2.0:1789117466.566733:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362396160 00000100:00100000:2.0:1789117466.566846:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 87 00000100:00100000:2.0:1789117466.566864:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+21:10673:x1876025362396160:12345-192.168.206.37@tcp:54:lfs.0 00010000:00010000:2.0:1789117466.566927:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e2a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.566943:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.566954:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.566979:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.566987:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e2a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.566994:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e2a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.567000:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117466.567004:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e2a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.567023:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e2a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.567042:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782c0e700) 00010000:00010000:2.0:1789117466.567045:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789117466.567050:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e2a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.567056:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e2a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117466.567140:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+21:10673:x1876025362396160:12345-192.168.206.37@tcp:54:lfs.0 Request processed in 278us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117466.567149:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 87 00000100:00100000:1.0:1789117466.569316:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117466.569476:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362396416 00000100:00100000:0.0:1789117466.569484:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362396416 00000100:00100000:0.0:1789117466.569584:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 21 00000100:00100000:0.0:1789117466.569595:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a9737050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+21:10673:x1876025362396416:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:0.0:1789117466.569847:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a9737050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+22:10673:x1876025362396416:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 254us (537us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789117466.569855:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 21 00000100:00100000:0.0:1789117466.589523:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117466.589620:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362396672 00000100:00100000:1.0:1789117466.589628:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362396672 00000100:00100000:1.0:1789117466.589680:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 88 00000100:00100000:1.0:1789117466.589689:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+22:10202:x1876025362396672:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:1.0:1789117466.589709:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117466.589726:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e2ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c8a2 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.589809:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e2b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.589824:0:7242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e299 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c89b expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.589831:0:7242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e2b5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.589860:0:7242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e299 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c89b expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.589889:0:7242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e299 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c89b expref: 23 pid: 5841 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117466.589903:0:7242:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ae1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7242:1876025385486208:192.168.206.37@tcp:104: 00000100:00100000:1.0:1789117466.589990:0:7242:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178720eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789117466.594497:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117466.594624:0:7242:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ae1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7242:1876025385486208:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117466.594649:0:7242:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e2b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117466.595073:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362396800 00000100:00100000:2.0:1789117466.595079:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362396800 00010000:00010000:2.0:1789117466.595117:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e299 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c89b expref: 24 pid: 5841 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117466.595157:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 52 00000100:00100000:2.0:1789117466.595166:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+24:2349:x1876025362396800:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117466.595180:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117466.595186:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e299 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c89b expref: 24 pid: 5841 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.595197:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e299 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c89b expref: 24 pid: 5841 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.595216:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e299 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c89b expref: 24 pid: 5841 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.595953:0:7638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782c0e700) 00010000:00010000:2.0:1789117466.595961:0:7638:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e2b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.595970:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e2b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.596024:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e2b5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.596296:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117466.596368:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+23:2349:x1876025362396800:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 1200us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117466.596377:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 52 00010000:00010000:3.0:1789117466.597817:0:7242:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e2b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.597832:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e2b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117466.597854:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789117466.598098:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e2ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8a2 expref: 24 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.598121:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e2b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8a2 expref: 23 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.598130:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782c0e700) 00010000:00010000:3.0:1789117466.598133:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789117466.598136:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e400, rc 0) 00000100:00100000:3.0:1789117466.598714:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+23:10202:x1876025362396672:12345-192.168.206.37@tcp:101:bash.0 Request processed in 9022us (9195us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789117466.598724:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 88 00000100:00100000:1.0:1789117466.606585:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117466.606666:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362397056 00000100:00100000:3.0:1789117466.606688:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362397056 00000100:00100000:3.0:1789117466.606746:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 89 00000100:00100000:3.0:1789117466.606755:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+23:10202:x1876025362397056:12345-192.168.206.37@tcp:36:bash.0 00010000:00010000:3.0:1789117466.607009:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.607025:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.607046:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789117466.607096:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1789117466.607122:0:5839:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000cf37a4c5 reply state 0000000052592c85 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117466.607131:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789117466.607212:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1789117466.607318:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+27:10202:x1876025362397056:12345-192.168.206.37@tcp:36:bash.0 Request processed in 562us (752us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1789117466.607326:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 89 00000020:00080000:3.0:1789117466.607331:0:5839:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789117466.609996:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00010000:00010000:1.0:1789117466.610097:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.610108:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.610114:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.610120:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781684000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117466.610125:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.610132:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.610148:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782c0e700) 00010000:00010000:1.0:1789117466.610151:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117466.610156:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.610162:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117466.611275:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362397184 00000100:00100000:0.0:1789117466.611286:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362397184 00000100:00100000:0.0:1789117466.611392:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 90 00000100:00100000:0.0:1789117466.611420:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+26:10202:x1876025362397184:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:0.0:1789117466.611441:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117466.611458:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e2ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c8a9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.611526:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e2ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8a9 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.611539:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e2ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8a9 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.611556:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782c0e700) 00010000:00010000:0.0:1789117466.611559:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789117466.611562:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbd800, rc 0) 00000100:00100000:0.0:1789117466.611620:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+27:10202:x1876025362397184:12345-192.168.206.37@tcp:101:bash.0 Request processed in 219us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117466.611627:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 90 00000100:00100000:1.0:1789117466.615660:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117466.615778:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362397312 00000100:00100000:2.0:1789117466.615787:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362397312 00000100:00100000:2.0:1789117466.615845:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 33 00000100:00100000:2.0:1789117466.615855:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+6:10202:x1876025362397312:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:2.0:1789117466.615871:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117466.615890:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363c6d1f/0xf7565228e460e2d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c8b0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789117466.615916:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3c418, atime: 0x6aa3c416, ctime: 0x6aa3c418, blocks: 0xb 00010000:00010000:2.0:1789117466.615935:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=313s v=(0 0) 00010000:00010000:2.0:1789117466.615939:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117466.615948:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363c6d1f/0xf7565228e460e2d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8b0 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.615963:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363c6d1f/0xf7565228e460e2d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8b0 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.615975:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457fa00, rc 0) 00000100:00100000:2.0:1789117466.616063:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+7:10202:x1876025362397312:12345-192.168.206.37@tcp:101:bash.0 Request processed in 209us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117466.616070:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 33 00000100:00100000:1.0:1789117466.618058:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117466.618648:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362397440 00000100:00100000:2.0:1789117466.618657:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362397440 00002000:00010000:2.0:1789117466.618694:0:6690:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1789117466.618699:0:6690:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c17b87ac3c0 with x1876025362397440 ext(0->18446744073709551615) 00002000:00010000:2.0:1789117466.618709:0:6690:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c17b87ac3c0. 00000100:00100000:2.0:1789117466.618740:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 1 00000100:00100000:2.0:1789117466.618750:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e0c4e520-7af6-449d-969f-b46035974613+7:2349:x1876025362397440:12345-192.168.206.37@tcp:10:bash.0 00002000:00010000:2.0:1789117466.618993:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789117466.618997:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789117464 -> 1789117465 00002000:00010000:2.0:1789117466.619000:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789117462 -> 1789117462 00002000:00010000:2.0:1789117466.619002:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789117464 -> 1789117465 00002000:00010000:2.0:1789117466.619004:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789117466.619064:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e0c4e520-7af6-449d-969f-b46035974613+8:2349:x1876025362397440:12345-192.168.206.37@tcp:10:bash.0 Request processed in 314us (1012us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789117466.619072:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 1 00002000:00010000:2.0:1789117466.619075:0:6690:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1789117466.619078:0:6690:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c17b87ac3c0 with x1876025362397440 ext(0->18446744073709551615) 00002000:00010000:2.0:1789117466.619083:0:6690:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c17b87ac3c0. 00000100:00100000:1.0:1789117466.672119:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117466.672215:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362397568 00000100:00100000:3.0:1789117466.672239:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362397568 00000100:00100000:3.0:1789117466.672298:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 91 00000100:00100000:3.0:1789117466.672307:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+27:10687:x1876025362397568:12345-192.168.206.37@tcp:34:lfs.0 00010000:00010000:3.0:1789117466.672376:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e2d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.672394:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e2d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.672454:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e2d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.672470:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.672478:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.672484:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.672983:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e2e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.672992:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.672999:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789117466.673044:0:5839:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673055:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e2d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673061:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e2d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673067:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e2d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673084:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781684c00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117466.673088:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e2d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673095:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e2d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673107:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:3.0:1789117466.673109:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117466.673114:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e2d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673121:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e2d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673134:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673140:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673145:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673150:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781684000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117466.673152:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673158:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673179:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c1782df4900) 00010000:00010000:3.0:1789117466.673181:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117466.673184:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673189:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673202:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673207:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e2e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673212:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e2e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673216:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117466.673219:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e2e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673224:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e2e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673230:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782c0e700) 00010000:00010000:3.0:1789117466.673232:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117466.673235:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e2e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.673559:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e2e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117466.673662:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+27:10687:x1876025362397568:12345-192.168.206.37@tcp:34:lfs.0 Request processed in 1354us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117466.673670:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 91 00000100:00100000:1.0:1789117466.712329:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117466.712471:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362397824 00000100:00100000:3.0:1789117466.712480:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362397824 00000100:00100000:3.0:1789117466.712543:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 92 00000100:00100000:3.0:1789117466.712555:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+27:10690:x1876025362397824:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:3.0:1789117466.712586:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117466.712607:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e2ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c8b7 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.712675:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.712690:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.712701:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.712717:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e2fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.713048:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e2fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.713058:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e2fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.713551:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e302 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.713820:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.713831:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117466.713842:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789117466.713925:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.713933:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.713940:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.713946:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781684000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117466.713950:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.713958:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.713968:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:3.0:1789117466.713971:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117466.713974:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.713990:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e2f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.714002:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e2fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.714008:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e2fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.714014:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e2fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.714019:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781684c00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117466.714021:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e2fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.714126:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e2fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.714137:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c1782df4900) 00010000:00010000:3.0:1789117466.714139:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117466.714142:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e2fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.714148:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e2fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.714188:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e2ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8b7 expref: 30 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.714200:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e302 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8b7 expref: 29 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.714213:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782c0e700) 00010000:00010000:3.0:1789117466.714215:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789117466.714218:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685200, rc 0) 00000100:00100000:3.0:1789117466.714329:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+29:10690:x1876025362397824:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 1776us (2008us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1789117466.714337:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 92 00000100:00100000:1.0:1789117466.723502:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117466.723606:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362397952 00000100:00100000:2.0:1789117466.723615:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362397952 00000100:00100000:2.0:1789117466.723673:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 93 00000100:00100000:2.0:1789117466.723684:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+29:10690:x1876025362397952:12345-192.168.206.37@tcp:54:lfs.0 00010000:00010000:2.0:1789117466.723746:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e310 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.723773:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e2b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8a2 expref: 29 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.723783:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e310 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.723815:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e2b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8a2 expref: 29 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.723829:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e2b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8a2 expref: 29 pid: 7242 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117466.723843:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876025385486336:192.168.206.37@tcp:104: 00000100:00100000:2.0:1789117466.723927:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788257a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789117466.726549:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876025385486336:192.168.206.37@tcp:104: 00010000:00010000:2.0:1789117466.726578:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e310 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117466.726811:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117466.726964:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362398208 00000100:00100000:2.0:1789117466.726971:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362398208 00000100:00100000:2.0:1789117466.727067:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 22 00000100:00100000:2.0:1789117466.727077:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+30:5602:x1876025362398208:12345-192.168.206.37@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789117466.727570:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+31:5602:x1876025362398208:12345-192.168.206.37@tcp:35:ldlm_bl.0 Request processed in 493us (758us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1789117466.727580:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 22 00000100:00100000:1.0:1789117466.729805:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117466.729901:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362398336 00000100:00100000:0.0:1789117466.729910:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362398336 00010000:00010000:0.0:1789117466.729944:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e2b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8a2 expref: 31 pid: 7242 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117466.729973:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 53 00000100:00100000:0.0:1789117466.729995:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+31:2350:x1876025362398336:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117466.730010:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117466.730017:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e2b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8a2 expref: 31 pid: 7242 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.730045:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e2b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8a2 expref: 31 pid: 7242 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.730197:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e2b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8a2 expref: 31 pid: 7242 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.730215:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782c0e700) 00010000:00010000:0.0:1789117466.730220:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e310 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.730229:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.730236:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e310 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.730265:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117466.730299:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.730314:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117466.730317:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+30:2350:x1876025362398336:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 336us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117466.730325:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 53 00010000:00010000:2.0:1789117466.730342:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.730348:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e310 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.730355:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.730361:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117466.730365:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.730372:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e310 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.730381:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782c0e700) 00010000:00010000:2.0:1789117466.730384:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789117466.730388:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e310 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.730395:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e310 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117466.730605:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+29:10690:x1876025362397952:12345-192.168.206.37@tcp:54:lfs.0 Request processed in 6922us (7112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117466.730614:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 93 00000100:00100000:1.0:1789117466.738162:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117466.738710:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362398592 00000100:00100000:0.0:1789117466.738719:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362398592 00000100:00100000:0.0:1789117466.738928:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 23 00000100:00100000:0.0:1789117466.738940:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+29:10690:x1876025362398592:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:0.0:1789117466.739678:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+30:10690:x1876025362398592:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 737us (1583us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789117466.739687:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 23 00000100:00100000:1.0:1789117466.854811:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117466.854983:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362398848 00000100:00100000:0.0:1789117466.854992:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362398848 00000100:00100000:0.0:1789117466.855056:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 94 00000100:00100000:0.0:1789117466.855081:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+30:10701:x1876025362398848:12345-192.168.206.37@tcp:101:cat.0 00010000:00010000:0.0:1789117466.855103:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117466.855123:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e317 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c8be expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855192:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e31e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855214:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e31e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855225:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e31e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855241:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e325 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855248:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855254:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855609:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e32c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855619:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e32c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855626:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e32c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117466.855650:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1789117466.855738:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e31e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855746:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e31e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855752:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e31e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855758:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117466.855761:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e31e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855768:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e31e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855780:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:0.0:1789117466.855783:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117466.855787:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e31e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855793:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e31e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855805:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855812:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e325 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855829:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855835:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbcc00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117466.855838:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855844:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e325 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855851:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c1782c0ea00) 00010000:00010000:0.0:1789117466.855854:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117466.855856:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e325 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855861:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e325 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855904:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e317 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8be expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855918:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e32c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8be expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.855924:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782c0e700) 00010000:00010000:0.0:1789117466.855927:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117466.855929:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbde00, rc 0) 00000100:00100000:0.0:1789117466.855996:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+32:10701:x1876025362398848:12345-192.168.206.37@tcp:101:cat.0 Request processed in 918us (1192us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1789117466.856013:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 94 00000100:00100000:1.0:1789117466.864275:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117466.864365:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362399104 00000100:00100000:0.0:1789117466.864374:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362399104 00000100:00100000:0.0:1789117466.864459:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 24 00000100:00100000:0.0:1789117466.864469:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+32:10701:x1876025362399104:12345-192.168.206.37@tcp:35:cat.0 00000100:00100000:0.0:1789117466.864693:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+33:10701:x1876025362399104:12345-192.168.206.37@tcp:35:cat.0 Request processed in 224us (427us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789117466.864706:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 24 00000100:00100000:1.0:1789117466.895515:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117466.895689:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362399360 00000100:00100000:3.0:1789117466.895698:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362399360 00000100:00100000:3.0:1789117466.895756:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 95 00000100:00100000:3.0:1789117466.895921:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+33:10702:x1876025362399360:12345-192.168.206.37@tcp:36:rm.0 00010000:00010000:3.0:1789117466.895976:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789117466.896034:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e32c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8be expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.896058:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e302 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8b7 expref: 32 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.896072:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e2ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8a9 expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.896081:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782c0e700) 00010000:00010000:3.0:1789117466.896092:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789117466.896112:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e33a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.896124:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e33a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.896147:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e33a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.896163:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e341 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.896170:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e341 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.896176:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e341 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.896522:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e348 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.896531:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e348 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.896538:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e348 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789117466.897136:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1789117466.897147:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 314026745818ns, next at 315026743350ns, rc = 0 00010000:00010000:3.0:1789117466.897205:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e34f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.897215:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e34f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.897228:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e34f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.897247:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e34f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.897254:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e34f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.897260:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e34f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.897283:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117466.897302:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e348 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.897308:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e348 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.897314:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e348 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.897320:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781684000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117466.897324:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e348 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.897330:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e348 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.897340:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782df4100) 00010000:00010000:3.0:1789117466.897343:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789117466.897347:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e348 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.897363:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e348 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.897382:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e33a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.897388:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e33a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.897393:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e33a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.897427:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117466.897431:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e33a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.897441:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e33a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.897449:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:3.0:1789117466.897451:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117466.897454:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e33a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.897459:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e33a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789117466.897469:0:5839:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000b94fa07 reply state 00000000250077d1 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e341 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117466.897476:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789117466.897557:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+32:10702:x1876025362399360:12345-192.168.206.37@tcp:36:rm.0 Request processed in 1639us (2049us total) trans 4294967375 rc 0/0 00010000:00010000:1.0:1789117466.898428:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117466.898436:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e34f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.898443:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685400 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:1.0:1789117466.898447:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e34f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.898453:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e34f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.898463:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c1782df4100) 00010000:00010000:1.0:1789117466.898466:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789117466.898469:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e34f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.898474:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e34f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.898503:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117466.898504:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117466.898506:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117466.903674:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 95 00010000:00010000:2.0:1789117466.903999:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e341 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.904022:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e341 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.904037:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e341 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.904044:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781684c00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117466.904048:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e341 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.904056:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e341 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.904069:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c1782df4900) 00010000:00010000:2.0:1789117466.904072:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117466.904077:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e341 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.904084:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e341 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117466.958486:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117466.958567:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362399616 00000100:00100000:0.0:1789117466.958574:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362399616 00000100:00100000:0.0:1789117466.958618:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 96 00000100:00100000:0.0:1789117466.958625:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+31:10708:x1876025362399616:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:0.0:1789117466.958644:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117466.958660:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e356 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c8c5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.958767:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e35d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.958783:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e35d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.958791:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e35d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.958801:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e364 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.958821:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.958825:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789117466.959370:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1789117466.959596:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e36b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.959606:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e36b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.959615:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e36b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.959649:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e35d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.959656:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e35d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.959663:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e35d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.959669:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbcc00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117466.959673:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e35d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.959680:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e35d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.959703:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:0.0:1789117466.959706:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117466.959711:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e35d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.959717:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e35d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789117466.959729:0:5841:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002d608770 reply state 00000000cd713758 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117466.959737:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789117466.959765:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e356 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8c5 expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.959778:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e36b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8c5 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.959785:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1782c0e100) 00010000:00010000:0.0:1789117466.959787:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117466.959789:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbc000, rc 0) 00000100:00100000:0.0:1789117466.959848:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+34:10708:x1876025362399616:12345-192.168.206.37@tcp:101:bash.0 Request processed in 1222us (1368us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789117466.959857:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 96 00000100:00100000:1.0:1789117466.962384:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117466.962458:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362399744 00000100:00100000:3.0:1789117466.962467:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362399744 00010000:00010000:2.0:1789117466.962507:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.962518:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e364 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117466.962524:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 34 00010000:00010000:2.0:1789117466.962535:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e364 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117466.962537:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+7:2352:x1876025362399744:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:3.0:1789117466.962557:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117466.962566:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117466.962572:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e364 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.962576:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcf3ba90/0xf7565228e460e379 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c8cc expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.962582:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e364 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.962602:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c1782c0ea00) 00002000:00010000:3.0:1789117466.962605:0:8269:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789117466.962606:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117466.962613:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e364 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.962621:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e364 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.962626:0:8269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=314s v=(0 0) 00010000:00010000:3.0:1789117466.962632:0:8269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117466.962642:0:8269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcf3ba90/0xf7565228e460e379 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8cc expref: 8 pid: 8269 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.962659:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fcf3ba90/0xf7565228e460e379 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8cc expref: 8 pid: 8269 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117466.962670:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685600, rc 0) 00000100:00100000:3.0:1789117466.962727:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+8:2352:x1876025362399744:12345-192.168.206.37@tcp:101:bash.0 Request processed in 192us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117466.962734:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 34 00000100:00100000:1.0:1789117466.966016:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117466.966096:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362399872 00000100:00100000:2.0:1789117466.966104:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362399872 00000100:00100000:2.0:1789117466.966157:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 35 00000100:00100000:2.0:1789117466.966167:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+8:10708:x1876025362399872:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:2.0:1789117466.966182:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117466.966199:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf30c74a/0xf7565228e460e380 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c8d3 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.966227:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcf3ba90/0xf7565228e460e379 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8cc expref: 9 pid: 8269 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.966235:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117466.966240:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117466.966256:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf30c74a/0xf7565228e460e380 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8d3 expref: 9 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.966287:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fcf3ba90/0xf7565228e460e379 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8cc expref: 9 pid: 8269 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117466.966301:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fcf3ba90/0xf7565228e460e379 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8cc expref: 9 pid: 8269 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117466.966314:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1876025385486464:192.168.206.37@tcp:104: 00000100:00100000:2.0:1789117466.966425:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788257a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789117466.969221:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117466.969302:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1876025385486464:192.168.206.37@tcp:104: 00010000:00010000:0.0:1789117466.969334:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cf30c74a/0xf7565228e460e380 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8d3 expref: 9 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117466.969371:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457e600, rc 0) 00000100:00100000:0.0:1789117466.969455:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+9:10708:x1876025362399872:12345-192.168.206.37@tcp:101:bash.0 Request processed in 3288us (3446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117466.969465:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 35 00000100:00100000:1.0:1789117466.970131:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362400000 00000100:00100000:1.0:1789117466.970139:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362400000 00010000:00010000:1.0:1789117466.970174:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fcf3ba90/0xf7565228e460e379 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8cc expref: 9 pid: 8269 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117466.970212:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 54 00000100:00100000:1.0:1789117466.970221:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+9:2349:x1876025362400000:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117466.970234:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117466.970254:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fcf3ba90/0xf7565228e460e379 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8cc expref: 9 pid: 8269 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.970266:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fcf3ba90/0xf7565228e460e379 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8cc expref: 9 pid: 8269 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.970287:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcf3ba90/0xf7565228e460e379 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8cc expref: 9 pid: 8269 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.970302:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117466.970306:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117466.970321:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf30c74a/0xf7565228e460e380 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8d3 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.970331:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf30c74a/0xf7565228e460e380 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8d3 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117466.970386:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cf30c74a/0xf7565228e460e380 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8d3 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117466.970430:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b885e580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5826:1876025385486592:192.168.206.37@tcp:105: 00000100:00100000:1.0:1789117466.970500:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178720ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117466.973475:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b885e580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5826:1876025385486592:192.168.206.37@tcp:105: 00010000:00010000:1.0:1789117466.973496:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117466.973511:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117466.973544:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+8:2349:x1876025362400000:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 3324us (4333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117466.973555:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 54 00000100:00100000:0.0:1789117466.973564:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362400256 00000100:00100000:0.0:1789117466.973570:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362400256 00000100:00100000:0.0:1789117466.973619:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 25 00000100:00100000:0.0:1789117466.973628:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+33:10708:x1876025362400256:12345-192.168.206.37@tcp:35:bash.0 00000100:00100000:0.0:1789117466.974515:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+34:10708:x1876025362400256:12345-192.168.206.37@tcp:35:bash.0 Request processed in 884us (1000us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789117466.974524:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 25 00000100:00100000:2.0:1789117467.086690:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117467.087747:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362400384 00000100:00100000:1.0:1789117467.087821:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362400384 00000100:00100000:1.0:1789117467.087887:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 97 00000100:00100000:1.0:1789117467.087898:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8850b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+34:10724:x1876025362400384:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117467.087921:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117467.087940:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e387 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c8da expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.088015:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e38e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.088052:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e38e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.088063:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e38e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117467.088126:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1789117467.088129:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789117467.088150:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e38e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.088175:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e387 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8da expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.088195:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e38e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8da expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.088203:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:1.0:1789117467.088206:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789117467.088210:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442fe00, rc 0) 00000100:00100000:1.0:1789117467.088271:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8850b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+35:10724:x1876025362400384:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 374us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117467.088278:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 97 00000100:00100000:3.0:1789117467.097493:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117467.099737:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362400640 00000100:00100000:1.0:1789117467.099752:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362400640 00000100:00100000:1.0:1789117467.099829:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 98 00000100:00100000:1.0:1789117467.099840:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0217c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+35:10724:x1876025362400640:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117467.099858:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117467.099909:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e395 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c8e1 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.100550:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e39c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.100565:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e39c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.100576:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e39c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117467.100587:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789117467.100780:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e395 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8e1 expref: 38 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.100802:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e39c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8e1 expref: 37 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.100811:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1782c0e100) 00010000:00010000:1.0:1789117467.100814:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117467.100817:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e800, rc 0) 00000100:00100000:1.0:1789117467.102279:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0217c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+37:10724:x1876025362400640:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 2433us (4787us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789117467.102290:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 98 00000100:00100000:2.0:1789117467.106903:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117467.106953:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117467.106964:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362400896 00000100:00100000:3.0:1789117467.106973:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362400896 00000100:00100000:1.0:1789117467.107046:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362401024 00000100:00100000:1.0:1789117467.107051:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362401024 00000100:00100000:3.0:1789117467.107063:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 6 00000100:00100000:3.0:1789117467.107072:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8850f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+38:2350:x1876025362400896:12345-192.168.206.37@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789117467.107080:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 99 00000100:00100000:1.0:1789117467.107085:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8852940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+38:10724:x1876025362401024:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:3.0:1789117467.107086:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117467.107110:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e39c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8e1 expref: 38 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.107113:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117467.107127:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e3aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c8e8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.107131:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1782c0e100) 00010000:00010000:3.0:1789117467.107136:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117467.107183:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8850f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+38:2350:x1876025362400896:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 111us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117467.107190:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 6 00010000:00010000:1.0:1789117467.107206:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e3b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.107224:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.107235:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117467.107246:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789117467.107359:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e3aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8e8 expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.107373:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e3b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8e8 expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.107381:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1782c0e100) 00010000:00010000:1.0:1789117467.107384:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789117467.107387:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e600, rc 0) 00000100:00100000:1.0:1789117467.107449:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8852940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+38:10724:x1876025362401024:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 363us (495us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1789117467.107455:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 99 00000100:00100000:2.0:1789117467.115842:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117467.115930:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362401152 00000100:00100000:3.0:1789117467.115939:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362401152 00000100:00100000:3.0:1789117467.116142:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 36 00000100:00100000:3.0:1789117467.116152:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8852d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+8:2352:x1876025362401152:12345-192.168.206.37@tcp:1:lfs.0 00010000:00010000:3.0:1789117467.116192:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d1ea30f/0xf7565228e460e3bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.116210:0:8269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf30c74a/0xf7565228e460e380 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8d3 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.116219:0:8269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117467.116223:0:8269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789117467.116227:0:8269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d1ea30f/0xf7565228e460e3bf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.116261:0:8269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf30c74a/0xf7565228e460e380 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8d3 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.116290:0:8269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf30c74a/0xf7565228e460e380 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8d3 expref: 8 pid: 6687 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117467.116317:0:8269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02143c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8269:1876025385486720:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117467.116445:0:8269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1782dfd600 going to sleep for 11 seconds 00000100:00100000:0.0:1789117467.120452:0:8269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02143c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8269:1876025385486720:192.168.206.37@tcp:104: 00010000:00010000:0.0:1789117467.120480:0:8269:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004d1ea30f/0xf7565228e460e3bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117467.121939:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117467.125511:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362401280 00000100:00100000:1.0:1789117467.125523:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362401280 00002000:00100000:1.0:1789117467.125571:0:6691:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9c17b8850780 x1876025362401280/t0(0) o4->e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp:18/0 lens 504/0 e 0 to 0 dl 1789117478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117467.125593:0:6691:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c17b8850780 with x1876025362401280 ext(0->8) 00010000:00010000:1.0:1789117467.125604:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cf30c74a/0xf7565228e460e380 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8d3 expref: 9 pid: 6687 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.125635:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cf30c74a/0xf7565228e460e380 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8d3 expref: 9 pid: 6687 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789117467.125644:0:6691:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c17b8850780 00000100:00100000:1.0:1789117467.125948:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 1 00000100:00100000:1.0:1789117467.125959:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8850780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e0c4e520-7af6-449d-969f-b46035974613+9:2349:x1876025362401280:12345-192.168.206.37@tcp:4:lfs.0 00000100:00100000:1.0:1789117467.128044:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8850780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e0c4e520-7af6-449d-969f-b46035974613+11:2349:x1876025362401280:12345-192.168.206.37@tcp:4:lfs.0 Request processed in 2069us (6093us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789117467.128057:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 1 00002000:00100000:1.0:1789117467.128069:0:6691:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9c17b8850780 x1876025362401280/t4294967302(0) o4->e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp:18/0 lens 504/448 e 0 to 0 dl 1789117478 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117467.128087:0:6691:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c17b8850780 with x1876025362401280 ext(0->8) 00010000:00010000:1.0:1789117467.128097:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cf30c74a/0xf7565228e460e380 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8d3 expref: 11 pid: 6687 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.128115:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cf30c74a/0xf7565228e460e380 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8d3 expref: 11 pid: 6687 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789117467.128122:0:6691:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c17b8850780 00000100:00100000:3.0:1789117467.135587:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117467.135787:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362401408 00000100:00100000:2.0:1789117467.135798:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362401408 00010000:00010000:2.0:1789117467.135841:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf30c74a/0xf7565228e460e380 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8d3 expref: 11 pid: 6687 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117467.136080:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 55 00000100:00100000:2.0:1789117467.136091:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17845e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+11:2350:x1876025362401408:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117467.136107:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789117467.136138:0:7638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789117467.136141:0:7638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789117466 00002000:00010000:2.0:1789117467.136143:0:7638:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789117466 00002000:00010000:2.0:1789117467.136145:0:7638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789117466 00010000:00010000:2.0:1789117467.136151:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf30c74a/0xf7565228e460e380 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8d3 expref: 11 pid: 6687 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117467.136166:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf30c74a/0xf7565228e460e380 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8d3 expref: 11 pid: 6687 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117467.136185:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf30c74a/0xf7565228e460e380 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8d3 expref: 11 pid: 6687 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117467.136200:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789117467.136203:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789117467.136209:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004d1ea30f/0xf7565228e460e3bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117467.136219:0:7638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d1ea30f/0xf7565228e460e3bf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117467.138434:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117467.138500:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17845e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+10:2350:x1876025362401408:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 2405us (2916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117467.138511:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 55 00010000:00010000:0.0:1789117467.138571:0:8269:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004d1ea30f/0xf7565228e460e3bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.138586:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d1ea30f/0xf7565228e460e3bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.139770:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d1ea30f/0xf7565228e460e3bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.139806:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d1ea30f/0xf7565228e460e3bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.139815:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d1ea30f/0xf7565228e460e3bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.139823:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781684000 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:0.0:1789117467.139828:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d1ea30f/0xf7565228e460e3bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.139838:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d1ea30f/0xf7565228e460e3bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.139857:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d1ea30f/0xf7565228e460e3bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.139866:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d1ea30f/0xf7565228e460e3bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117467.139992:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8852d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+9:2352:x1876025362401152:12345-192.168.206.37@tcp:1:lfs.0 Request processed in 23838us (24154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117467.140002:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 36 00000100:00100000:3.0:1789117467.145648:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117467.146188:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362401664 00000100:00100000:1.0:1789117467.146208:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362401664 00000100:00100000:1.0:1789117467.146312:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 26 00000100:00100000:1.0:1789117467.146323:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a9737450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+38:10724:x1876025362401664:12345-192.168.206.37@tcp:35:lfs.0 00000004:00010000:1.0:1789117467.146394:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e3b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8e8 expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789117467.146701:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1789117467.146743:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1789117467.147076:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1789117467.147125:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e3c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.147139:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e36b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8c5 expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.147149:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e3c6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.147180:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e36b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8c5 expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.147194:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e36b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8c5 expref: 42 pid: 5841 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117467.147207:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b885e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1876025385486848:192.168.206.37@tcp:104: 00000100:00100000:1.0:1789117467.147287:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178720e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117467.150628:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b885e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1876025385486848:192.168.206.37@tcp:104: 00010000:00010000:1.0:1789117467.150656:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e3c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117467.151826:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117467.152285:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362401792 00000100:00100000:0.0:1789117467.152293:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362401792 00010000:00010000:0.0:1789117467.152350:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e36b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8c5 expref: 43 pid: 5841 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117467.152440:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 56 00000100:00100000:0.0:1789117467.152451:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0214b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+43:2349:x1876025362401792:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117467.152465:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117467.152472:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e36b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8c5 expref: 43 pid: 5841 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.152485:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e36b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8c5 expref: 43 pid: 5841 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.152507:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e36b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8c5 expref: 43 pid: 5841 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.152521:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1782c0e100) 00010000:00010000:0.0:1789117467.152526:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e3c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.152534:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e3c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.152541:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e3c6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.152560:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117467.152703:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0214b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+42:2349:x1876025362401792:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 253us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117467.152711:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 56 00010000:00010000:1.0:1789117467.152777:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e3c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.152785:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e3c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789117467.152906:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1789117467.153285:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1789117467.153381:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b885e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1876025385486976:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789117467.153476:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117467.153508:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178720ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789117467.154223:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385486976 00000100:00100000:2.0:1789117467.154230:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385486976 00000100:00100000:2.0:1789117467.154291:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789117467.154310:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5842:x1876025385486976:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789117467.154425:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5842:x1876025385486976:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 116us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117467.154433:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789117467.154702:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b885e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1876025385486976:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789117467.155485:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1789117467.155557:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b885e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1876025385487104:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789117467.155600:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117467.155685:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178720e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789117467.157254:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385487104 00000100:00100000:2.0:1789117467.157265:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385487104 00000100:00100000:2.0:1789117467.157571:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789117467.157582:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5842:x1876025385487104:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789117467.158087:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5842:x1876025385487104:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 507us (2485us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789117467.158096:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789117467.158246:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b885e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1876025385487104:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789117467.158320:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1789117467.158370:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e3c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.158380:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e3c6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.158388:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e3c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.158394:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ee00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117467.158644:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e3c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.158653:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e3c6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.158734:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1782c0e100) 00010000:00010000:1.0:1789117467.158738:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789117467.158743:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e3c6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.158750:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e3c6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789117467.159169:0:5842:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789117467.159265:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1789117467.159276:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 314288875774ns, next at 315288873687ns, rc = 0 00000001:00080000:1.0:1789117467.159283:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1789117467.159319:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1782c0e100) 00010000:00010000:1.0:1789117467.159322:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789117467.159330:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e3b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8e8 expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117467.159598:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a9737450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+45:10724:x1876025362401664:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 13276us (13958us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1789117467.159606:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 26 00000020:00080000:1.0:1789117467.159611:0:5842:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789117467.164446:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117467.164518:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362401920 00000100:00100000:2.0:1789117467.164526:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362401920 00000100:00100000:2.0:1789117467.164575:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 100 00000100:00100000:2.0:1789117467.164585:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0214f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+45:10724:x1876025362401920:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:2.0:1789117467.164606:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117467.164628:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e3cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c8ef expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117467.164694:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e3cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8ef expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117467.164708:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e3cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8ef expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117467.164726:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:2.0:1789117467.164736:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789117467.164740:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457e600, rc 0) 00000100:00100000:2.0:1789117467.165304:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0214f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+46:10724:x1876025362401920:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 711us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117467.165311:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 100 00000100:00100000:3.0:1789117467.168232:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117467.169097:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362402176 00000100:00100000:0.0:1789117467.169117:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362402176 00000100:00100000:0.0:1789117467.169209:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 27 00000100:00100000:0.0:1789117467.169219:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0216940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+46:10724:x1876025362402176:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:0.0:1789117467.169454:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0216940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+47:10724:x1876025362402176:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 236us (1230us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1789117467.169462:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 27 00000100:00100000:0.0:1789117467.206385:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0215a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385487488:0@lo:400:kworker.0 00000100:00100000:0.0:1789117467.206481:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117467.206522:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789117467.206530:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0215e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385487616:0@lo:400:kworker.0 00000100:00100000:0.0:1789117467.206562:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117467.206575:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0214780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876025385487360:0@lo:400:kworker.0 00000100:00100000:0.0:1789117467.206599:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385487488 00000100:00100000:0.0:1789117467.206606:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385487488 00000100:00100000:3.0:1789117467.206614:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117467.206641:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789117467.206648:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0216d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385487232:0@lo:400:kworker.0 00000100:00100000:0.0:1789117467.206658:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385487360 00000100:00100000:3.0:1789117467.206675:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117467.206675:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385487360 00000100:00100000:3.0:1789117467.206708:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876025385487744:0@lo:400:kworker.0 00000100:00100000:0.0:1789117467.206712:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789117467.206723:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385487488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117467.206734:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117467.206759:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385487744 00000100:00100000:3.0:1789117467.206763:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385487744 00000100:00100000:0.0:1789117467.206784:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385487488:12345-0@lo:400:kworker.0 Request processed in 62us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117467.206790:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789117467.206798:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789117467.206802:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876025385487360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117467.206825:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789117467.206835:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876025385487744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117467.206845:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876025385487360:12345-0@lo:400:kworker.0 Request processed in 45us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117467.206853:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789117467.206875:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876025385487744:12345-0@lo:400:kworker.0 Request processed in 41us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117467.206883:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:3.0:1789117467.206886:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117467.206901:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385487616 00000100:00100000:3.0:1789117467.206905:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385487616 00000100:00100000:3.0:1789117467.206932:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789117467.206939:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1876025385487616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117467.206974:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1876025385487616:12345-0@lo:400:kworker.0 Request processed in 35us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117467.206980:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789117467.207180:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0215a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385487488:0@lo:400:kworker.0 00000100:00100000:0.0:1789117467.207219:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0215e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385487616:0@lo:400:kworker.0 00000100:00100000:3.0:1789117467.207305:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876025385487744:0@lo:400:kworker.0 00000100:00100000:3.0:1789117467.207316:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0214780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876025385487360:0@lo:400:kworker.0 00000100:00100000:2.0:1789117467.207830:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385487232 00000100:00100000:2.0:1789117467.207836:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385487232 00000100:00100000:2.0:1789117467.207878:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789117467.207885:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3299:x1876025385487232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117467.208136:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3299:x1876025385487232:12345-0@lo:400:kworker.0 Request processed in 250us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117467.208145:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789117467.208347:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0216d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385487232:0@lo:400:kworker.0 00000100:00100000:1.0:1789117467.284817:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117467.285019:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362402304 00000100:00100000:3.0:1789117467.285037:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362402304 00000100:00100000:3.0:1789117467.285094:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 101 00000100:00100000:3.0:1789117467.285105:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+47:10734:x1876025362402304:12345-192.168.206.37@tcp:34:lfs.0 00010000:00010000:3.0:1789117467.285172:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e3d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285188:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e3d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285199:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e3d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285213:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e3db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285220:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e3db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285239:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e3db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285340:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e3e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285349:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285356:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789117467.285395:0:5839:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285434:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e3d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285440:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e3d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285446:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e3d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285451:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781684000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117467.285456:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e3d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285463:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e3d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285475:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:3.0:1789117467.285484:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117467.285489:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e3d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285495:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e3d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285508:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e3db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285514:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e3db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285519:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e3db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285524:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117467.285526:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e3db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285531:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e3db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285537:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c1782df4300) 00010000:00010000:3.0:1789117467.285540:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117467.285542:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e3db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285547:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e3db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.285561:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.286595:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e3e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.286604:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e3e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.286609:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117467.286613:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e3e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.286621:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e3e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.286631:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:3.0:1789117467.286634:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117467.286637:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e3e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117467.286643:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e3e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117467.286747:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+47:10734:x1876025362402304:12345-192.168.206.37@tcp:34:lfs.0 Request processed in 1641us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117467.286756:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 101 00000100:00100000:2.0:1789117467.339862:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117467.340326:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362402560 00000100:00100000:0.0:1789117467.340335:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362402560 00000100:00100000:0.0:1789117467.340392:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 102 00000100:00100000:0.0:1789117467.340552:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8850f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+47:10737:x1876025362402560:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:0.0:1789117467.340571:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117467.340592:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e3e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c8f6 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.340656:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e3f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.340671:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.340681:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.340696:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e3f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.340702:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.340708:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.340833:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e3fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.340858:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.340865:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117467.340875:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789117467.340966:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.340974:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e3f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.340980:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e3f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.340987:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbce00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117467.340991:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e3f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.340999:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e3f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.341010:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:0.0:1789117467.341013:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117467.342255:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e3f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.342273:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e3f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.342290:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.342325:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e3f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.342331:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.342336:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbcc00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117467.342339:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.342346:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e3f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.342357:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c1782c0ed00) 00010000:00010000:0.0:1789117467.342360:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117467.342363:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e3f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.342368:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e3f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.342826:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e3e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8f6 expref: 50 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.342841:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e3fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8f6 expref: 49 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.342848:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:0.0:1789117467.342850:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117467.342859:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbca00, rc 0) 00000100:00100000:0.0:1789117467.342968:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8850f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+49:10737:x1876025362402560:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 2567us (3115us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1789117467.342978:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 102 00000100:00100000:2.0:1789117467.351636:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117467.351778:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362402688 00000100:00100000:0.0:1789117467.351788:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362402688 00000100:00100000:0.0:1789117467.351844:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 103 00000100:00100000:0.0:1789117467.351855:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8851a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+49:10737:x1876025362402688:12345-192.168.206.37@tcp:54:lfs.0 00010000:00010000:0.0:1789117467.351918:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e40c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.351934:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e40c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.351945:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e40c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.351969:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e40c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.351976:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e40c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.351982:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e40c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.351988:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbdc00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117467.351992:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e40c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.351999:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e40c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.352199:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:0.0:1789117467.352203:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789117467.352208:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e40c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.352214:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e40c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117467.352790:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8851a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+49:10737:x1876025362402688:12345-192.168.206.37@tcp:54:lfs.0 Request processed in 934us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117467.352799:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 103 00000100:00100000:1.0:1789117467.363515:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117467.363735:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362402944 00000100:00100000:2.0:1789117467.363746:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362402944 00000100:00100000:2.0:1789117467.363879:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 28 00000100:00100000:2.0:1789117467.363891:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+49:10737:x1876025362402944:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:2.0:1789117467.364147:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+50:10737:x1876025362402944:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 258us (639us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789117467.364156:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 28 00010000:00010000:0.0:1789117467.461550:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117467.480221:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117467.480467:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362403200 00000100:00100000:0.0:1789117467.480476:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362403200 00000100:00100000:0.0:1789117467.480536:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 104 00000100:00100000:0.0:1789117467.480547:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8851e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+50:10747:x1876025362403200:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:0.0:1789117467.480569:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117467.480572:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789117467.480597:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e38e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8da expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.480617:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:0.0:1789117467.480622:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117467.480635:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e413 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c8fd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.480718:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e41a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.480743:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e41a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.480752:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e41a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117467.480764:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789117467.480876:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e413 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8fd expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.480890:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e41a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8fd expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.480896:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:0.0:1789117467.480898:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117467.480901:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbc000, rc 0) 00000100:00100000:0.0:1789117467.480961:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8851e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+51:10747:x1876025362403200:12345-192.168.206.37@tcp:101:bash.0 Request processed in 415us (749us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1789117467.480968:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 104 00000100:00100000:3.0:1789117467.483857:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117467.483952:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362403456 00000100:00100000:1.0:1789117467.483973:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362403456 00000100:00100000:1.0:1789117467.484043:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 105 00000100:00100000:1.0:1789117467.484053:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0216d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+51:10747:x1876025362403456:12345-192.168.206.37@tcp:36:bash.0 00010000:00010000:1.0:1789117467.484101:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789117467.484123:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e41a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8fd expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.484145:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e3fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8f6 expref: 50 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.484156:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:1.0:1789117467.484161:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789117467.484344:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e428 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.484356:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.484364:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789117467.484437:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1789117467.484458:0:5839:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000052c8a82b reply state 00000000e1f6eb38 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117467.484467:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789117467.484551:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0216d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+52:10747:x1876025362403456:12345-192.168.206.37@tcp:36:bash.0 Request processed in 500us (714us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1789117467.484559:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 105 00000020:00080000:1.0:1789117467.484563:0:5839:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789117467.492589:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117467.492606:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e428 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117467.492631:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e428 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117467.492637:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ec00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117467.492641:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e428 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117467.492649:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e428 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117467.492664:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:2.0:1789117467.492667:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117467.492672:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e428 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117467.492679:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e428 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117467.493881:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117467.494292:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362403584 00000100:00100000:0.0:1789117467.494303:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362403584 00000100:00100000:0.0:1789117467.494368:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 106 00000100:00100000:0.0:1789117467.494380:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0214780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+51:10747:x1876025362403584:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:0.0:1789117467.494427:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117467.494448:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e42f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c904 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.494539:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e436 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.494553:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.494564:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117467.494590:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789117467.494594:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789117467.494612:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.494638:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e42f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c904 expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.494654:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e436 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c904 expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.494663:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:0.0:1789117467.494666:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117467.494670:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbcc00, rc 0) 00000100:00100000:0.0:1789117467.494842:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0214780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+52:10747:x1876025362403584:12345-192.168.206.37@tcp:101:bash.0 Request processed in 457us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117467.494850:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 106 00000100:00100000:1.0:1789117467.499976:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117467.500080:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362403840 00000100:00100000:2.0:1789117467.500089:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362403840 00000100:00100000:2.0:1789117467.500147:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 29 00000100:00100000:2.0:1789117467.500158:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+52:10747:x1876025362403840:12345-192.168.206.37@tcp:35:bash.0 00000100:00100000:2.0:1789117467.500381:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+53:10747:x1876025362403840:12345-192.168.206.37@tcp:35:bash.0 Request processed in 223us (413us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1789117467.500390:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 29 00000100:00100000:3.0:1789117467.550790:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117467.550953:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362403968 00000100:00100000:1.0:1789117467.550961:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362403968 00000100:00100000:1.0:1789117467.551040:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 107 00000100:00100000:1.0:1789117467.551050:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+53:10753:x1876025362403968:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117467.551071:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117467.551089:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e43d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c90b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.551149:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e444 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.551162:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.551172:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117467.551227:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1789117467.551231:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789117467.551253:0:5839:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.551279:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e43d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c90b expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.551297:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e444 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c90b expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.551305:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:1.0:1789117467.551320:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789117467.551324:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e400, rc 0) 00000100:00100000:1.0:1789117467.551651:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+54:10753:x1876025362403968:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 601us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117467.551659:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 107 00000100:00100000:2.0:1789117467.563459:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117467.563554:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362404096 00000100:00100000:0.0:1789117467.563562:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362404096 00000100:00100000:0.0:1789117467.563664:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 108 00000100:00100000:0.0:1789117467.563675:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b88512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+54:10753:x1876025362404096:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:0.0:1789117467.563693:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117467.563711:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e44b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c912 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.563769:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e452 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.563784:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e452 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.563795:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e452 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.563809:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460e459 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.563817:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460e459 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.563823:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460e459 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.563908:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e460 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.563916:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.563923:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117467.563963:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789117467.563967:0:7242:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789117467.563983:0:7242:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.563994:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.564002:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e452 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.564009:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e452 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.564016:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e452 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.564034:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbce00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117467.564039:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e452 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.564046:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e452 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.564057:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:0.0:1789117467.564069:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117467.564074:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e452 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.564081:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e452 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.564102:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460e459 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.564108:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460e459 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.564114:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460e459 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.564119:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbc800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117467.564122:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460e459 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.564129:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460e459 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.564137:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c1782c0ed00) 00010000:00010000:0.0:1789117467.564140:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117467.564143:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460e459 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.564149:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460e459 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.564185:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e44b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c912 expref: 56 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.564197:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c912 expref: 55 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.564215:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:0.0:1789117467.564217:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117467.564220:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbd000, rc 0) 00000100:00100000:0.0:1789117467.564291:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b88512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+55:10753:x1876025362404096:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 617us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117467.564298:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 108 00000100:00100000:2.0:1789117467.567301:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117467.567892:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362404352 00000100:00100000:1.0:1789117467.567901:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362404352 00000100:00100000:1.0:1789117467.567960:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 109 00000100:00100000:1.0:1789117467.567972:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+55:10753:x1876025362404352:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117467.567989:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117467.568007:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e467 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c919 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.568100:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e46e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.568113:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e436 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c904 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.568122:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e460 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c912 expref: 56 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.568130:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e46e lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.568159:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c912 expref: 56 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.568171:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e460 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c912 expref: 56 pid: 7242 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117467.568197:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b885cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876025385487872:192.168.206.37@tcp:104: 00010000:00010000:1.0:1789117467.568299:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e436 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c904 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.568307:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e436 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c904 expref: 56 pid: 5841 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117467.568316:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b885cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876025385488000:192.168.206.37@tcp:104: 00000100:00100000:1.0:1789117467.568338:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178720e900 going to sleep for 11 seconds 00000100:00100000:2.0:1789117467.568658:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117467.568913:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362404480 00000100:00100000:1.0:1789117467.568918:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362404480 00010000:00010000:1.0:1789117467.568940:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e460 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c912 expref: 57 pid: 7242 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117467.568969:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 57 00000100:00100000:1.0:1789117467.568976:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8853480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+57:2349:x1876025362404480:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117467.568986:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117467.568991:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e460 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c912 expref: 57 pid: 7242 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.569002:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e460 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c912 expref: 57 pid: 7242 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.569019:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:1.0:1789117467.569034:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e46e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.569047:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e46e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.569054:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117467.569085:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8853480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+57:2349:x1876025362404480:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 109us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117467.569093:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 57 00010000:00010000:1.0:1789117467.571313:0:5839:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.37@tcp) returned -22 from blocking AST (req@000000006c3772f8 x1876025385487872) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e460 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c912 expref: 56 pid: 7242 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.571342:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e460 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c912 expref: 56 pid: 7242 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117467.571361:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b885cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876025385487872:192.168.206.37@tcp:104: 00000100:00100000:1.0:1789117467.571375:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b885cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876025385488000:192.168.206.37@tcp:104: 00010000:00010000:1.0:1789117467.571480:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:1.0:1789117467.571486:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e46e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.571495:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e46e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.571503:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e46e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117467.571803:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117467.572496:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362404608 00000100:00100000:2.0:1789117467.572503:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362404608 00010000:00010000:2.0:1789117467.572539:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e436 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c904 expref: 56 pid: 5841 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117467.572576:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 58 00000100:00100000:2.0:1789117467.572585:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0216580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+56:2349:x1876025362404608:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117467.572598:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117467.572604:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e436 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c904 expref: 56 pid: 5841 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117467.572616:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e436 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c904 expref: 56 pid: 5841 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117467.572635:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e436 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c904 expref: 56 pid: 5841 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117467.572649:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:2.0:1789117467.572653:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e46e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117467.572661:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e46e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117467.572669:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e46e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117467.572692:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117467.572738:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0216580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+55:2349:x1876025362404608:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 153us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117467.572756:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 58 00010000:00010000:1.0:1789117467.577456:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e46e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.577492:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e46e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117467.577515:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789117467.577667:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e467 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c919 expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.577687:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e46e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c919 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.577696:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:1.0:1789117467.577699:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789117467.577702:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442fa00, rc 0) 00000100:00100000:1.0:1789117467.577770:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+55:10753:x1876025362404352:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 9801us (10476us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1789117467.577778:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 109 00000100:00100000:3.0:1789117467.580147:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117467.580222:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362404864 00000100:00100000:1.0:1789117467.580231:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362404864 00000100:00100000:1.0:1789117467.580285:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 7 00000100:00100000:1.0:1789117467.580294:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0217480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+55:10753:x1876025362404864:12345-192.168.206.37@tcp:103:lfs.0 00010000:00010000:1.0:1789117467.580308:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117467.580329:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e3cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8ef expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.580355:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:1.0:1789117467.580360:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117467.580437:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0217480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+54:10753:x1876025362404864:12345-192.168.206.37@tcp:103:lfs.0 Request processed in 143us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117467.580444:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 7 00000100:00100000:2.0:1789117467.582518:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117467.582939:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362404992 00000100:00100000:0.0:1789117467.582947:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362404992 00000100:00100000:0.0:1789117467.583082:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 110 00000100:00100000:0.0:1789117467.583092:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8853840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+54:10753:x1876025362404992:12345-192.168.206.37@tcp:58:lfs.0 00010000:00010000:0.0:1789117467.583175:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e47c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.583190:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e47c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117467.583202:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e47c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789117467.583374:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789117467.583484:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8853840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+54:10753:x1876025362404992:12345-192.168.206.37@tcp:58:lfs.0 Request processed in 393us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117467.583491:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 110 00000100:00100000:2.0:1789117467.595583:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117467.600649:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362405120 00000100:00100000:0.0:1789117467.600664:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362405120 00000100:00100000:1.0:1789117467.600845:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 111 00000100:00100000:1.0:1789117467.600855:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8852580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+54:10753:x1876025362405120:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117467.600874:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117467.600893:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e483 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c920 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.600945:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e47c lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.600956:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e483 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c920 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.600973:0:5840:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e47c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.600985:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e483 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c920 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.600997:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:1.0:1789117467.601001:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789117467.601004:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e483 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c920 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117467.601012:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442f000, rc 0) 00000100:00100000:1.0:1789117467.601079:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8852580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+55:10753:x1876025362405120:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 225us (5505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117467.601097:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 111 00000100:00100000:2.0:1789117467.717772:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117467.717795:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b885cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385488128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117467.717832:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117467.717857:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0217840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385488256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117467.717864:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117467.717949:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385488128 00000100:00100000:2.0:1789117467.717955:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385488128 00000100:00100000:2.0:1789117467.717995:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789117467.718003:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b88521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876025385488128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789117467.718044:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789117467.718083:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b88521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876025385488128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117467.718091:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789117467.718132:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b885cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385488128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117467.718662:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117467.719004:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385488256 00000100:00100000:2.0:1789117467.719011:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385488256 00000100:00100000:2.0:1789117467.719097:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789117467.719106:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0215e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3301:x1876025385488256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789117467.719120:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789117467.719166:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0215e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3301:x1876025385488256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117467.719172:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789117467.719243:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0217840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385488256:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1789117468.293702:0:12082:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789117468.293711:0:12082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789117468.293748:0:12082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1789117468.293760:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789117468.293873:0:12082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b88530c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12082:1876025385488384:192.168.206.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789117468.293978:0:12082:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788257480 going to sleep for 11 seconds 00000100:00100000:1.0:1789117468.298133:0:12082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b88530c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12082:1876025385488384:192.168.206.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789117468.298579:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117468.298825:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362405248 00000100:00100000:0.0:1789117468.298833:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362405248 00000100:00100000:0.0:1789117468.298916:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 112 00000100:00100000:0.0:1789117468.298927:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8851680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+55:10754:x1876025362405248:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789117468.298957:0:7242:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789117468.299088:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8851680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+55:10754:x1876025362405248:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 Request processed in 163us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117468.299096:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 112 00000100:00080000:3.0:1789117468.299382:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117468.313460:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117468.313635:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362405376 00000100:00100000:1.0:1789117468.313646:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362405376 00000100:00100000:1.0:1789117468.313790:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 113 00000100:00100000:1.0:1789117468.313804:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8853c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+55:10754:x1876025362405376:12345-192.168.206.37@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789117468.313879:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e48a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.313897:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e48a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.313912:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e48a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.313972:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e491 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.313979:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e491 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.313986:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e491 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.314804:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e498 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.314814:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.314840:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117468.314879:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789117468.314883:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789117468.314894:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.314905:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e48a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.314911:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e48a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.314917:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e48a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.314923:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117468.314927:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e48a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.314934:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e48a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.314944:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1788d9e000) 00010000:00010000:1.0:1789117468.314947:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117468.314952:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e48a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.314958:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e48a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.314982:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e491 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.314988:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e491 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.315152:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e491 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.315157:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ec00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117468.315160:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e491 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.315167:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e491 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.315176:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9c1788d9ec00) 00010000:00010000:1.0:1789117468.315179:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117468.315182:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e491 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.315187:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e491 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.315203:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.315209:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e498 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.315215:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.315226:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442fe00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117468.315230:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.315236:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e498 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.315244:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:1.0:1789117468.315246:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117468.315250:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e498 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.315255:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e498 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117468.315340:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8853c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+55:10754:x1876025362405376:12345-192.168.206.37@tcp:34:lhsmtool_posix.0 Request processed in 1539us (1887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117468.315349:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 113 00000100:00100000:1.0:1789117468.324897:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117468.325006:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362405632 00000100:00100000:0.0:1789117468.325015:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362405632 00000100:00100000:0.0:1789117468.325152:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 114 00000100:00100000:0.0:1789117468.325162:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+55:10754:x1876025362405632:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117468.325180:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117468.325198:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460e49f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c927 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.325288:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e4a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.325303:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.325314:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117468.325325:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789117468.325456:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.325464:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e4a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.325502:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.325508:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbce00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117468.325512:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.325520:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e4a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.325531:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:0.0:1789117468.325534:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789117468.325539:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e4a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.325545:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460e4a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.325583:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460e49f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c927 expref: 57 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.325593:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1788d9e000) 00010000:00010000:0.0:1789117468.325596:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789117468.325600:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460e49f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c927 expref: 57 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.325609:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbc800, rc 0) 00000100:00100000:0.0:1789117468.325673:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+56:10754:x1876025362405632:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 512us (784us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1789117468.325690:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 114 00000100:00100000:2.0:1789117468.336752:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117468.336943:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362405760 00000100:00100000:3.0:1789117468.336952:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362405760 00000100:00100000:3.0:1789117468.337025:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 115 00000100:00100000:3.0:1789117468.337037:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b88503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+56:10754:x1876025362405760:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789117468.337069:0:5839:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789117468.337176:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b88503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+56:10754:x1876025362405760:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 Request processed in 141us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117468.337184:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 115 00000100:00100000:3.0:1789117468.345890:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117468.346541:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362406016 00000100:00100000:2.0:1789117468.346551:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362406016 00000100:00100000:2.0:1789117468.346612:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 116 00000100:00100000:2.0:1789117468.346632:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0217840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+56:10754:x1876025362406016:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117468.346651:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117468.346654:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789117468.346680:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e444 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c90b expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.346700:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:2.0:1789117468.346705:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117468.346716:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e4b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c92e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789117468.347114:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789117468.347301:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e4bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.347313:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e4bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.347321:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e4bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.348330:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e4b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c92e expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.348360:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e4bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c92e expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.348374:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c1783e89d00) 00010000:00010000:2.0:1789117468.348377:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117468.348381:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f600, rc 0) 00000100:00100000:2.0:1789117468.348468:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0217840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+57:10754:x1876025362406016:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 1848us (2587us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1789117468.348476:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 116 00000100:00100000:0.0:1789117468.363886:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117468.364117:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362406272 00000100:00100000:3.0:1789117468.364127:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362406272 00000100:00100000:3.0:1789117468.364182:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 117 00000100:00100000:3.0:1789117468.364192:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+57:10754:x1876025362406272:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789117468.364244:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117468.364268:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e4bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c92e expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117468.364285:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c1783e89d00) 00010000:00010000:3.0:1789117468.364295:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789117468.364315:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e4c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117468.364327:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e4c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117468.364362:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e4c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117468.364381:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e4d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x588304fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117468.364386:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e4d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x588304fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117468.364390:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e4d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x588304fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117468.364464:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e4c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117468.364469:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e4c9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117468.364473:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e4c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117468.364477:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117468.364479:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e4c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117468.364484:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e4c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117468.364489:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:3.0:1789117468.364494:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117468.364497:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e4c9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117468.364507:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e4c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117468.364515:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e4d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x588304fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117468.364518:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e4d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x588304fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117468.364522:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e4d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x588304fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117468.364525:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117468.364526:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e4d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x588304fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117468.364529:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e4d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x588304fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117468.364534:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x588304fd (ffff9c1782df4300) 00010000:00010000:3.0:1789117468.364535:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117468.364537:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e4d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x588304fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117468.364540:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e4d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x588304fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117468.364599:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+56:10754:x1876025362406272:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 Request processed in 410us (725us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789117468.364606:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 117 00000100:00100000:0.0:1789117468.369443:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117468.369557:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362406400 00000100:00100000:2.0:1789117468.369566:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362406400 00000100:00100000:2.0:1789117468.369629:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 118 00000100:00100000:2.0:1789117468.369639:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+56:10754:x1876025362406400:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117468.369658:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117468.369681:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e4d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c935 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.369716:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e4de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.369729:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e4de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.369739:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e4de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.369839:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e4d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c935 expref: 58 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.369856:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e4de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c935 expref: 57 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.369865:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c1783e89400) 00010000:00010000:2.0:1789117468.369867:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789117468.369871:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f200, rc 0) 00000100:00100000:2.0:1789117468.370135:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+57:10754:x1876025362406400:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 496us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117468.370143:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 118 00000100:00100000:3.0:1789117468.378058:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117468.378123:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362406656 00000100:00100000:1.0:1789117468.378132:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362406656 00000100:00100000:1.0:1789117468.378198:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 119 00000100:00100000:1.0:1789117468.378208:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0215a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+57:10754:x1876025362406656:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789117468.378306:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e4e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.378321:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e4e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.378358:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e4e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789117468.378615:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1789117468.378625:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 315508224487ns, next at 316508221753ns, rc = 0 00000004:00010000:1.0:1789117468.378705:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000faa3d4e2 reply state 000000001cd66f99 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e4e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117468.378714:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789117468.384722:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0215a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+59:10754:x1876025362406656:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 Request processed in 6502us (6662us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1789117468.384735:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 119 00010000:00010000:2.0:1789117468.391780:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e4e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.391802:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e4e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.391810:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e4e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.391816:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442fe00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117468.391822:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e4e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.391830:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e4e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.391847:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c1783e89400) 00010000:00010000:2.0:1789117468.391866:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789117468.391872:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e4e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.391879:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e4e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117468.392061:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117468.392261:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362406784 00000100:00100000:2.0:1789117468.392271:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362406784 00000100:00100000:2.0:1789117468.392334:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 120 00000100:00100000:2.0:1789117468.392344:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+58:10754:x1876025362406784:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117468.392371:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117468.392388:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e4ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c93c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.392452:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e4ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c93c expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.392463:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e4ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c93c expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.392479:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c1783e89400) 00010000:00010000:2.0:1789117468.392481:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789117468.392484:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457ec00, rc 0) 00000100:00100000:2.0:1789117468.392540:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+59:10754:x1876025362406784:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 198us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117468.392547:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 120 00000100:00100000:0.0:1789117468.397598:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117468.397816:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362406912 00000100:00100000:1.0:1789117468.397826:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362406912 00000100:00080000:3.0:1789117468.397971:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117468.397973:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 37 00000100:00100000:1.0:1789117468.397988:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c013d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+8:2351:x1876025362406912:12345-192.168.206.37@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789117468.398305:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c013d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+9:2351:x1876025362406912:12345-192.168.206.37@tcp:2:lhsmtool_posix.0 Request processed in 320us (713us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789117468.398313:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 37 00000100:00100000:3.0:1789117468.406493:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117468.406664:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362407168 00000100:00100000:2.0:1789117468.406674:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362407168 00000100:00100000:2.0:1789117468.406751:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 30 00000100:00100000:2.0:1789117468.406762:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+59:10754:x1876025362407168:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789117468.407008:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+60:10754:x1876025362407168:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 Request processed in 246us (524us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1789117468.407016:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 30 00000100:00100000:0.0:1789117468.413490:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117468.415206:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362407424 00000100:00100000:2.0:1789117468.415219:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362407424 00000100:00100000:2.0:1789117468.415290:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 121 00000100:00100000:2.0:1789117468.415303:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+60:10754:x1876025362407424:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789117468.416740:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+60:10754:x1876025362407424:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 Request processed in 1432us (3250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117468.416753:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 121 00000100:00100000:0.0:1789117468.422788:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117468.423915:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362407552 00000100:00100000:2.0:1789117468.423926:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362407552 00000100:00100000:2.0:1789117468.423979:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 122 00000100:00100000:2.0:1789117468.423989:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+60:10754:x1876025362407552:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117468.424009:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117468.424041:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e4f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c943 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.424111:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e4fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.424125:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e4fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.424137:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e4fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117468.424184:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789117468.424201:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e4fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.424225:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e4f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c943 expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.424243:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e4fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c943 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.424251:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c1783e89400) 00010000:00010000:2.0:1789117468.424254:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789117468.424257:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457e600, rc 0) 00000100:00100000:2.0:1789117468.424373:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+61:10754:x1876025362407552:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 385us (1594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117468.424381:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 122 00000100:00100000:2.0:1789117468.432416:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117468.432504:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362407680 00000100:00100000:0.0:1789117468.432514:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362407680 00000100:00100000:0.0:1789117468.432578:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 38 00000100:00100000:0.0:1789117468.432589:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8852d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+9:2350:x1876025362407680:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117468.432606:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117468.432639:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a2b4eaf/0xf7565228e460e501 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c94a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789117468.432665:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3c41b, blocks: 0x1 00010000:00010000:0.0:1789117468.432683:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=315s v=(0 0) 00010000:00010000:0.0:1789117468.432688:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117468.432696:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a2b4eaf/0xf7565228e460e501 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c94a expref: 10 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.432714:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000a2b4eaf/0xf7565228e460e501 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c94a expref: 10 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.432726:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbc800, rc 0) 00000100:00100000:0.0:1789117468.432798:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8852d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+10:2350:x1876025362407680:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 211us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117468.432805:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 38 00000100:00100000:0.0:1789117468.437973:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117468.438058:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362407936 00000100:00100000:2.0:1789117468.438068:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362407936 00000100:00100000:2.0:1789117468.438133:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 123 00000100:00100000:2.0:1789117468.438143:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+61:10754:x1876025362407936:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789117468.438247:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+61:10754:x1876025362407936:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 Request processed in 105us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117468.438254:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 123 00000100:00100000:2.0:1789117468.441773:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117468.441854:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362408064 00000100:00100000:0.0:1789117468.441863:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362408064 00000100:00100000:0.0:1789117468.441919:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 39 00000100:00100000:0.0:1789117468.441929:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b88530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+10:10754:x1876025362408064:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117468.441947:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117468.441966:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053851bab/0xf7565228e460e508 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c951 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.441997:0:8269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000a2b4eaf/0xf7565228e460e501 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c94a expref: 11 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.442007:0:8269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117468.442011:0:8269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117468.442016:0:8269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053851bab/0xf7565228e460e508 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c951 expref: 11 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.442062:0:8269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000a2b4eaf/0xf7565228e460e501 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c94a expref: 11 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.442086:0:8269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000a2b4eaf/0xf7565228e460e501 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c94a expref: 11 pid: 6685 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117468.442100:0:8269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f092c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8269:1876025385488512:192.168.206.37@tcp:104: 00000100:00100000:0.0:1789117468.442210:0:8269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f433c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117468.446368:0:8269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f092c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8269:1876025385488512:192.168.206.37@tcp:104: 00010000:00010000:0.0:1789117468.446614:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000053851bab/0xf7565228e460e508 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c951 expref: 11 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.446637:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbd000, rc 0) 00000100:00100000:0.0:1789117468.446772:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b88530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+11:10754:x1876025362408064:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 4843us (5010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117468.446781:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 39 00000100:00100000:2.0:1789117468.450953:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117468.451719:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362408192 00000100:00100000:0.0:1789117468.451731:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362408192 00010000:00010000:0.0:1789117468.451789:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000a2b4eaf/0xf7565228e460e501 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c94a expref: 11 pid: 6685 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117468.451839:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 59 00000100:00100000:0.0:1789117468.451850:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87afc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+11:2349:x1876025362408192:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117468.451868:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117468.451892:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000a2b4eaf/0xf7565228e460e501 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c94a expref: 11 pid: 6685 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.451908:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000a2b4eaf/0xf7565228e460e501 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c94a expref: 11 pid: 6685 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.451932:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a2b4eaf/0xf7565228e460e501 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c94a expref: 11 pid: 6685 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.451966:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117468.451972:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117468.451999:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053851bab/0xf7565228e460e508 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c951 expref: 10 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.452011:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053851bab/0xf7565228e460e508 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c951 expref: 10 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.452058:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000053851bab/0xf7565228e460e508 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c951 expref: 10 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117468.452072:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f092c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5825:1876025385488640:192.168.206.37@tcp:105: 00000100:00100000:0.0:1789117468.452161:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117468.461362:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117468.461475:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362408320 00000100:00100000:1.0:1789117468.461485:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362408320 00002000:00100000:1.0:1789117468.461538:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9c17b87af840 x1876025362408320/t0(0) o4->e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp:19/0 lens 504/0 e 0 to 0 dl 1789117479 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117468.461549:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c17b87af840 with x1876025362408320 ext(0->12) 00002000:00010000:1.0:1789117468.461556:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c17b87af840 00000100:00100000:1.0:1789117468.461587:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 2 00000100:00100000:1.0:1789117468.461619:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e0c4e520-7af6-449d-969f-b46035974613+11:2350:x1876025362408320:12345-192.168.206.37@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789117468.462074:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e0c4e520-7af6-449d-969f-b46035974613+13:2350:x1876025362408320:12345-192.168.206.37@tcp:4:lhsmtool_posix.0 Request processed in 456us (720us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789117468.462082:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 2 00002000:00100000:1.0:1789117468.462090:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9c17b87af840 x1876025362408320/t4294967308(0) o4->e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp:19/0 lens 504/448 e 0 to 0 dl 1789117479 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117468.462097:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c17b87af840 with x1876025362408320 ext(0->12) 00002000:00010000:1.0:1789117468.462101:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c17b87af840 00000100:00100000:0.0:1789117468.464028:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f092c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5825:1876025385488640:192.168.206.37@tcp:105: 00010000:00010000:0.0:1789117468.464055:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117468.464124:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87afc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+12:2349:x1876025362408192:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 12275us (13179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117468.464135:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 59 00000100:00100000:2.0:1789117468.468173:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117468.468271:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362408448 00000100:00100000:0.0:1789117468.468280:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362408448 00000100:00100000:0.0:1789117468.468350:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 124 00000100:00100000:0.0:1789117468.468360:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+61:10754:x1876025362408448:12345-192.168.206.37@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1789117468.485920:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117468.544541:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+61:10754:x1876025362408448:12345-192.168.206.37@tcp:44:lhsmtool_posix.0 Request processed in 76173us (76368us total) trans 0 rc 0/0 00000001:00080000:1.0:1789117468.544552:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000100:00100000:2.0:1789117468.544555:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 124 00000001:00080000:1.0:1789117468.544609:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:1.0:1789117468.544615:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:1.0:1789117468.544651:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789117468.544668:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c178720ec00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789117468.544672:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c178455bb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c178720e300 00000020:00080000:1.0:1789117468.544675:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c178455b300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c17c0043400 00000020:00080000:1.0:1789117468.544703:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c17b799a9c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789117468.544707:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c178455b700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c1783ef99c0 00000020:00080000:1.0:1789117468.544711:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c178455b200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c17894d5400 00000001:00080000:1.0:1789117468.544721:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:1.0:1789117468.544733:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1789117468.544743:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789117468.544968:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:3.0:1789117468.545110:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b885e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385488768:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789117468.545169:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789117468.545319:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789117468.545349:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385488768 00000100:00100000:0.0:1789117468.545357:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385488768 00000100:00100000:0.0:1789117468.545455:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789117468.545464:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3301:x1876025385488768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789117468.545485:0:6685:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1789117468.545521:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3c41a, atime: 0x6aa3c41a, ctime: 0x6aa3c41a, blocks: 0x1 00010000:00010000:0.0:1789117468.545528:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a2b4eaf/0xf7565228e460e50f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.545543:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=315s v=(0 0) 00010000:00010000:0.0:1789117468.545547:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117468.545553:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a2b4eaf/0xf7565228e460e50f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.545568:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a2b4eaf/0xf7565228e460e50f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.545577:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a2b4eaf/0xf7565228e460e50f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.545585:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a2b4eaf/0xf7565228e460e50f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.545599:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789117468.545968:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3301:x1876025385488768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 505us (798us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789117468.545975:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1789117468.545993:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117468.545999:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a2b4eaf/0xf7565228e460e50f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.546012:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbc800 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:0.0:1789117468.546029:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a2b4eaf/0xf7565228e460e50f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.546038:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a2b4eaf/0xf7565228e460e50f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.546054:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a2b4eaf/0xf7565228e460e50f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.546061:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a2b4eaf/0xf7565228e460e50f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.546086:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117468.546088:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117468.546090:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789117468.546116:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c17b885e940/2, rc 0, transno 4294967304 00000100:00100000:0.0:1789117468.546122:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b885e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385488768:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789117468.546321:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385489024:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1789117468.546367:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117468.546375:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117468.546426:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385489024 00000100:00100000:3.0:1789117468.546431:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385489024 00000100:00100000:3.0:1789117468.546462:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789117468.546469:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1876025385489024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789117468.546553:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117468.546560:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385488896:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789117468.546585:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117468.546618:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385488896 00000100:00100000:2.0:1789117468.546622:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385488896 00000100:00100000:2.0:1789117468.546660:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789117468.546668:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3299:x1876025385488896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789117468.546682:0:6685:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1789117468.546699:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460e516 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.546717:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363c6d1f/0xf7565228e460e2d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8b0 expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789117468.546720:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789117468.546726:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789117467 00002000:00010000:3.0:1789117468.546730:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:2.0:1789117468.546730:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00002000:00010000:3.0:1789117468.546736:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789117467 -> 1789117467 00010000:00010000:2.0:1789117468.546739:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00002000:00010000:3.0:1789117468.546740:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:2.0:1789117468.546747:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460e516 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.546775:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000363c6d1f/0xf7565228e460e2d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8b0 expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117468.546780:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3299:x1876025385489024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 310us (405us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789117468.546792:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1789117468.546808:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000363c6d1f/0xf7565228e460e2d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8b0 expref: 11 pid: 6687 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789117468.546810:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117468.546824:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ac780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1876025385489152:192.168.206.37@tcp:104: 00000100:00100000:2.0:1789117468.546888:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17981ca300 going to sleep for 11 seconds 00000004:00080000:2.0:1789117468.546912:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c17b87ada40/2, rc 0, transno 4294967309 00000100:00100000:2.0:1789117468.546917:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385489024:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789117468.549891:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117468.549994:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362408576 00000100:00100000:3.0:1789117468.550002:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362408576 00000100:00100000:3.0:1789117468.550061:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 43 00000100:00100000:3.0:1789117468.550070:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+12:2351:x1876025362408576:12345-192.168.206.37@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789117468.556278:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117468.556426:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362408704 00000100:00100000:0.0:1789117468.556435:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362408704 00010000:00010000:0.0:1789117468.556469:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000363c6d1f/0xf7565228e460e2d1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8b0 expref: 13 pid: 6687 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117468.557292:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 60 00000100:00100000:0.0:1789117468.557303:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+13:2349:x1876025362408704:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117468.557325:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117468.557332:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000363c6d1f/0xf7565228e460e2d1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8b0 expref: 13 pid: 6687 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.557347:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000363c6d1f/0xf7565228e460e2d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8b0 expref: 13 pid: 6687 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.557371:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789117468.557376:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789117468.557381:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460e516 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.557392:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460e516 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.557455:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117468.557820:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363c6d1f/0xf7565228e460e2d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c8b0 expref: 13 pid: 6687 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117468.557835:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ac780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1876025385489152:192.168.206.37@tcp:104: 00010000:00010000:2.0:1789117468.557855:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460e516 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.557865:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460e516 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.557872:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460e516 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.557882:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460e516 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.557901:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460e516 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.557915:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789117468.559214:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+12:2349:x1876025362408704:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 1771us (2802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117468.559227:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 60 00010000:00010000:1.0:1789117468.559327:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117468.559335:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460e516 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.559346:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e400 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:1.0:1789117468.559350:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460e516 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.559359:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460e516 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.559379:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460e516 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.559387:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460e516 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.559443:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117468.559446:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117468.559448:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117468.561818:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3299:x1876025385488896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15144us (15224us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789117468.561830:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1789117468.562318:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c17b87aed00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789117468.562325:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385488896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789117468.646087:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+11:2351:x1876025362408576:12345-192.168.206.37@tcp:16:lhsmtool_posix.0 Request processed in 96008us (96193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117468.646100:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 43 00000001:00080000:1.0:1789117468.646135:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1789117468.646145:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1789117468.646162:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1789117468.650888:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117468.651252:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362408960 00000100:00100000:2.0:1789117468.651260:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362408960 00000100:00100000:2.0:1789117468.651320:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 125 00000100:00100000:2.0:1789117468.651330:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+15:10754:x1876025362408960:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789117468.651381:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117468.651496:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e4fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c943 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.651513:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c1783e89400) 00010000:00010000:2.0:1789117468.651518:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789117468.653675:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e51d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.653711:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e51d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.653723:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e51d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789117468.655129:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000092f795a1 reply state 00000000e7fcbd87 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e51d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117468.655144:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789117468.655396:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+16:10754:x1876025362408960:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 Request processed in 4062us (4511us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1789117468.655426:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 125 00010000:00010000:2.0:1789117468.657850:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e51d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.657867:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e51d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.657875:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e51d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.657881:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117468.657904:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e51d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.657913:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e51d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.657929:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c1783e89400) 00010000:00010000:2.0:1789117468.657933:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117468.657938:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e51d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.657945:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e51d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117468.658771:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117468.659752:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362409088 00000100:00100000:0.0:1789117468.659763:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362409088 00000100:00100000:0.0:1789117468.659826:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 44 00000100:00100000:0.0:1789117468.659839:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+6:2350:x1876025362409088:12345-192.168.206.37@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789117468.660221:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789117468.660236:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789117467 -> 1789117466 00002000:00010000:0.0:1789117468.660238:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789117466 00002000:00010000:0.0:1789117468.660241:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789117467 -> 1789117466 00002000:00010000:0.0:1789117468.660243:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789117468.660359:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+7:2350:x1876025362409088:12345-192.168.206.37@tcp:2:lhsmtool_posix.0 Request processed in 522us (1592us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789117468.660368:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 44 00000100:00100000:0.0:1789117468.674856:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117468.675118:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362409344 00000100:00100000:2.0:1789117468.675129:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362409344 00000100:00100000:2.0:1789117468.675567:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 126 00000100:00100000:2.0:1789117468.675580:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+15:10754:x1876025362409344:12345-192.168.206.37@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789117468.675658:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e524 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.675674:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e4de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c935 expref: 15 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.675682:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e524 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.675715:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e4de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c935 expref: 15 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.675728:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e4de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c935 expref: 15 pid: 7242 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117468.675760:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c1680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876025385489280:192.168.206.37@tcp:104: 00000100:00100000:2.0:1789117468.675837:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1784c2a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117468.678796:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117468.678903:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c1680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876025385489280:192.168.206.37@tcp:104: 00010000:00010000:0.0:1789117468.678929:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e524 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117468.680206:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362409472 00000100:00100000:3.0:1789117468.680216:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362409472 00010000:00010000:3.0:1789117468.680262:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e4de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c935 expref: 16 pid: 7242 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117468.680314:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 61 00000100:00100000:3.0:1789117468.680322:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17845e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+16:2350:x1876025362409472:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117468.682203:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117468.682222:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e4de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c935 expref: 16 pid: 7242 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.682241:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e4de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c935 expref: 16 pid: 7242 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.682263:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e4de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c935 expref: 16 pid: 7242 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.682280:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c1783e89400) 00010000:00010000:2.0:1789117468.682285:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e524 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.682295:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e524 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.682302:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e524 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.682475:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117468.682547:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17845e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+15:2350:x1876025362409472:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 2224us (3757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117468.682558:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 61 00010000:00010000:0.0:1789117468.684134:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e524 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.684149:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e524 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.684178:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e524 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.684185:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e524 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.684192:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e524 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.684198:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457fa00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117468.684202:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e524 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.684226:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e524 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.684241:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c1783e89400) 00010000:00010000:0.0:1789117468.684244:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789117468.684248:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e524 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.684254:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e524 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117468.684511:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+14:10754:x1876025362409344:12345-192.168.206.37@tcp:55:lhsmtool_posix.0 Request processed in 8931us (9660us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789117468.684521:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 126 00000100:00100000:2.0:1789117468.688111:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117468.691212:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362409600 00000100:00100000:0.0:1789117468.691226:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362409600 00000100:00100000:0.0:1789117468.692189:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 45 00000100:00100000:0.0:1789117468.692201:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+7:2350:x1876025362409600:12345-192.168.206.37@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789117468.692245:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000017f7a225/0xf7565228e460e52b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.692264:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000053851bab/0xf7565228e460e508 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c951 expref: 7 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.692272:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117468.692276:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789117468.692281:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017f7a225/0xf7565228e460e52b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.692328:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000053851bab/0xf7565228e460e508 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c951 expref: 7 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.692343:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000053851bab/0xf7565228e460e508 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c951 expref: 7 pid: 8269 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117468.692358:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1876025385489408:192.168.206.37@tcp:104: 00000100:00100000:0.0:1789117468.692464:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f43cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117468.697079:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1876025385489408:192.168.206.37@tcp:104: 00010000:00010000:0.0:1789117468.697107:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017f7a225/0xf7565228e460e52b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117468.698202:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117468.698295:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362409728 00000100:00100000:0.0:1789117468.698302:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362409728 00010000:00010000:0.0:1789117468.698340:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000053851bab/0xf7565228e460e508 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c951 expref: 8 pid: 8269 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117468.698384:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 62 00000100:00100000:0.0:1789117468.698394:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+8:2349:x1876025362409728:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117468.698440:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117468.698461:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000053851bab/0xf7565228e460e508 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c951 expref: 8 pid: 8269 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.698475:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000053851bab/0xf7565228e460e508 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c951 expref: 8 pid: 8269 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.698509:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053851bab/0xf7565228e460e508 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c951 expref: 8 pid: 8269 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.698524:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789117468.698529:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789117468.698534:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017f7a225/0xf7565228e460e52b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.698543:0:7638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017f7a225/0xf7565228e460e52b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.698564:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117468.698620:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+7:2349:x1876025362409728:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 227us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117468.698629:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 62 00010000:00010000:2.0:1789117468.698949:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017f7a225/0xf7565228e460e52b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.698959:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017f7a225/0xf7565228e460e52b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.698984:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000017f7a225/0xf7565228e460e52b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.699002:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017f7a225/0xf7565228e460e52b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.699009:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017f7a225/0xf7565228e460e52b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.699025:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbcc00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117468.699029:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017f7a225/0xf7565228e460e52b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.699038:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017f7a225/0xf7565228e460e52b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.699050:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017f7a225/0xf7565228e460e52b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.699071:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017f7a225/0xf7565228e460e52b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117468.699128:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2350:x1876025362409600:12345-192.168.206.37@tcp:1:lhsmtool_posix.0 Request processed in 6928us (11024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117468.699136:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 45 00000100:00100000:2.0:1789117468.714279:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117468.714942:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362409984 00000100:00100000:0.0:1789117468.714952:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362409984 00000100:00100000:0.0:1789117468.715193:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 127 00000100:00100000:0.0:1789117468.715204:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+14:10754:x1876025362409984:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789117468.715277:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e532 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.715294:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.715304:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.716277:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e539 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.716294:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e4ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c93c expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.716302:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e539 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.716488:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e4ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c93c expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.716503:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e4ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c93c expref: 15 pid: 5841 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117468.716516:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f08000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876025385489536:192.168.206.37@tcp:104: 00000100:00100000:0.0:1789117468.716601:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f43cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117468.719206:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117468.719287:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362410112 00000100:00100000:2.0:1789117468.719294:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362410112 00010000:00010000:2.0:1789117468.719331:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e4ec lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c93c expref: 16 pid: 5841 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117468.719369:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 63 00000100:00100000:2.0:1789117468.719378:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+16:2350:x1876025362410112:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117468.719391:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117468.719465:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e4ec lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c93c expref: 16 pid: 5841 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.719478:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e4ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c93c expref: 16 pid: 5841 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.719497:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c1783e89400) 00010000:00010000:2.0:1789117468.719501:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e539 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.719509:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e539 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.719528:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e539 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.719545:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117468.719592:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+16:2350:x1876025362410112:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 215us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117468.719599:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 63 00010000:00010000:0.0:1789117468.719713:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e4ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c93c expref: 15 pid: 5841 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117468.719729:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f08000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876025385489536:192.168.206.37@tcp:104: 00010000:00010000:0.0:1789117468.719749:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e539 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.719870:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e539 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.719880:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e539 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789117468.720688:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1789117468.720853:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1789117468.720898:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1789117468.720979:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f08000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1876025385489664:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789117468.721212:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117468.721248:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f43e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789117468.722130:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385489664 00000100:00100000:2.0:1789117468.722139:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385489664 00000100:00100000:2.0:1789117468.722205:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789117468.722218:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1876025385489664:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789117468.722352:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1876025385489664:12345-0@lo:1000:mdt00_000.0 Request processed in 135us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117468.722362:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789117468.722493:0:5839:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1789117468.722501:0:5839:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1789117468.722525:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c17b87ada40, transno 4294967309 00000100:00100000:0.0:1789117468.722538:0:5839:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9c17b87aed00 x1876025385488896/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789117484 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117468.722549:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f08000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1876025385489664:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789117468.723811:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1789117468.723889:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f08000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1876025385489792:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789117468.723943:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117468.723981:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f43cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117468.724169:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385489792 00000100:00100000:3.0:1789117468.724177:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385489792 00000100:00100000:3.0:1789117468.724238:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789117468.724250:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1876025385489792:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789117468.724502:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5839:x1876025385489792:12345-0@lo:1000:mdt00_000.0 Request processed in 253us (555us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789117468.724512:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789117468.724759:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f08000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1876025385489792:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789117468.724793:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e539 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.724802:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e539 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.724809:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e539 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.724815:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbca00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117468.724831:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e539 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.724839:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e539 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.724852:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c1783e89400) 00010000:00010000:0.0:1789117468.724855:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789117468.724860:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e539 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.724867:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e539 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.724894:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e47c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.724900:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e47c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.724906:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e47c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.724911:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbdc00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117468.724914:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e47c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.724920:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e47c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.724927:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:0.0:1789117468.724930:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789117468.724943:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e483 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c920 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.724953:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e483 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c920 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.724962:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e483 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c920 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.725143:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e483 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c920 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117468.725161:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f0b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876025385489920:192.168.206.37@tcp:105: 00000100:00100000:0.0:1789117468.728129:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f43cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117468.735241:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117468.735356:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362410240 00000100:00100000:2.0:1789117468.735365:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362410240 00000100:00100000:2.0:1789117468.735459:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 31 00000100:00100000:2.0:1789117468.735471:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+19:10753:x1876025362410240:12345-192.168.206.37@tcp:49:lfs.0 00000100:00100000:2.0:1789117468.735602:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+19:10753:x1876025362410240:12345-192.168.206.37@tcp:49:lfs.0 Request processed in 134us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117468.735610:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 31 00000100:00100000:0.0:1789117468.736300:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f0b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876025385489920:192.168.206.37@tcp:105: 00010000:00010000:0.0:1789117468.736328:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e47c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.736395:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e47c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.737070:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e540 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.737083:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e540 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.737093:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e540 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.737119:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e540 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.737126:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e540 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.737132:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e540 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.737138:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbca00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117468.737142:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e540 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.737149:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e540 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.737160:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:0.0:1789117468.737163:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117468.737167:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e540 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.737172:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e540 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.737182:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.737188:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e532 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.737193:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e532 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.737204:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117468.737207:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e532 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.737212:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e532 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.737221:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:0.0:1789117468.737223:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789117468.737226:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e532 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.737231:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e532 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117468.737493:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+18:10754:x1876025362409984:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 Request processed in 22289us (23222us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1789117468.737502:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 127 00000020:00080000:0.0:1789117468.737507:0:5839:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789117468.737867:0:12082:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789117468.737872:0:12082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789117468.738392:0:12082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789117468.738435:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789117468.748718:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117468.748769:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117468.748795:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362410496 00000100:00100000:2.0:1789117468.748797:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362410752 00000100:00100000:2.0:1789117468.748805:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362410752 00000100:00100000:2.0:1789117468.748855:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 128 00000100:00100000:2.0:1789117468.748865:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+18:10753:x1876025362410752:12345-192.168.206.37@tcp:58:lfs.0 00000100:00100000:1.0:1789117468.748869:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362410496 00000100:00100000:1.0:1789117468.748902:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 32 00000100:00100000:1.0:1789117468.748912:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a9735050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+19:10754:x1876025362410496:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 00000040:00080000:2.0:1789117468.749487:0:7242:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1789117468.749567:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+19:10753:x1876025362410752:12345-192.168.206.37@tcp:58:lfs.0 Request processed in 702us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117468.749575:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 128 00000004:00080000:1.0:1789117468.750582:0:5843:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789117468.750668:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1789117468.750708:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e547 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.750733:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e547 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.750745:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e547 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.750755:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e547 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.750763:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e547 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.750769:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e547 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.750788:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789117468.750865:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a9735050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+20:10754:x1876025362410496:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 Request processed in 1952us (2152us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789117468.750873:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 32 00000020:00080000:1.0:1789117468.750878:0:5843:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789117468.750922:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117468.750928:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e547 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.750935:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e000 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:1.0:1789117468.750940:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e547 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.750949:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e547 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.750970:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c1788d9ec00) 00010000:00010000:1.0:1789117468.750973:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789117468.750978:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e547 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.750985:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e547 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.751000:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117468.751002:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117468.751003:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117468.779185:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117468.780198:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362410880 00000100:00100000:1.0:1789117468.780208:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362410880 00000100:00100000:1.0:1789117468.780270:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 129 00000100:00100000:1.0:1789117468.780281:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+20:10756:x1876025362410880:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117468.780303:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117468.780322:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e54e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c958 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.780393:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e555 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.780432:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e555 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.780443:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e555 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.780458:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e55c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.780477:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e55c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.780485:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e55c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.780745:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e563 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.780756:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e46e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c919 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.780775:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e563 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.780806:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e46e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c919 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117468.780820:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e46e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c919 expref: 21 pid: 5839 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117468.780834:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b885fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876025385490048:192.168.206.37@tcp:104: 00000100:00100000:1.0:1789117468.780911:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178720ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117468.784045:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117468.785428:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362411136 00000100:00100000:0.0:1789117468.785438:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362411136 00000100:00100000:0.0:1789117468.785490:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 33 00000100:00100000:0.0:1789117468.785502:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+22:5603:x1876025362411136:12345-192.168.206.37@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789117468.785881:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+23:5603:x1876025362411136:12345-192.168.206.37@tcp:35:ldlm_bl.0 Request processed in 381us (1842us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1789117468.785891:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 33 00000100:00100000:3.0:1789117468.787873:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b885fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876025385490048:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117468.787901:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e563 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117468.793848:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117468.793995:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362411264 00000100:00100000:2.0:1789117468.794005:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362411264 00010000:00010000:2.0:1789117468.794055:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e46e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c919 expref: 23 pid: 5839 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117468.794098:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 64 00000100:00100000:2.0:1789117468.794107:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+23:2350:x1876025362411264:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117468.794119:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117468.794125:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e46e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c919 expref: 23 pid: 5839 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.794137:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e46e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c919 expref: 23 pid: 5839 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.794159:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e46e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c919 expref: 23 pid: 5839 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.794174:0:7638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:2.0:1789117468.794179:0:7638:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e563 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.794189:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.794211:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e563 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117468.794244:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117468.794292:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+22:2350:x1876025362411264:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 186us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117468.794300:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 64 00010000:00010000:0.0:1789117468.794316:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.794342:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117468.794499:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789117468.794505:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789117468.794527:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.794540:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.794549:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e555 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.794556:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e555 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.794562:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e555 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.794569:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117468.794574:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e555 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.794581:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e555 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.794590:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:0.0:1789117468.794593:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117468.794597:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e555 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.794614:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e555 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.794626:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e55c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.794632:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e55c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.794638:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e55c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.794643:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ea00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117468.794647:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e55c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.794652:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e55c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.794662:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c1788d9ec00) 00010000:00010000:0.0:1789117468.794665:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117468.794669:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e55c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.794674:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e55c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.794895:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e54e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c958 expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.794911:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e563 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c958 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117468.794925:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:0.0:1789117468.794927:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117468.795000:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e600, rc 0) 00000100:00100000:0.0:1789117468.795097:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+21:10756:x1876025362410880:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 14817us (15921us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117468.795105:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 129 00000001:00080000:2.0:1789117468.827816:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1789117468.827840:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:1.0:1789117469.510665:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789117469.603913:0:12451:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789117469.603922:0:12451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789117469.603967:0:12451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789117469.603979:0:12451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789117469.766568:0:12082:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789117469.766577:0:12082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789117469.766620:0:12082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789117469.766627:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789117469.766731:0:12082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b885d2c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12082:1876025385490176:192.168.206.37@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789117469.766823:0:12082:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178720e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117469.769272:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117469.769302:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362411392 00000100:00100000:2.0:1789117469.769310:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362411392 00000100:00100000:2.0:1789117469.769370:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 130 00000100:00100000:2.0:1789117469.769380:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+22:10769:x1876025362411392:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789117469.769434:0:7242:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789117469.769537:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+22:10769:x1876025362411392:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 Request processed in 157us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117469.769544:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 130 00000100:00100000:3.0:1789117469.771698:0:12082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b885d2c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12082:1876025385490176:192.168.206.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789117469.772188:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117469.772289:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362411648 00000100:00100000:3.0:1789117469.772296:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362411648 00000100:00100000:3.0:1789117469.772357:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 131 00000100:00100000:3.0:1789117469.772367:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+21:10769:x1876025362411648:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789117469.772386:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117469.772437:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e56a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c95f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117469.772527:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e571 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117469.772558:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117469.772570:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117469.772586:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789117469.772679:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e56a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c95f expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117469.772697:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e571 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c95f expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117469.772705:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:3.0:1789117469.772708:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789117469.772711:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781684000, rc 0) 00000100:00100000:3.0:1789117469.772759:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+23:10769:x1876025362411648:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 393us (572us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789117469.772766:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 131 00000100:00100000:2.0:1789117469.778689:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117469.778748:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117469.778926:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362412032 00000100:00100000:1.0:1789117469.778937:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362412032 00000100:00100000:1.0:1789117469.779031:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 8 00000100:00100000:1.0:1789117469.779042:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02161c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+23:2350:x1876025362412032:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117469.779058:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117469.779085:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e571 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c95f expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117469.779103:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:1.0:1789117469.779109:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117469.779155:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02161c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+22:2350:x1876025362412032:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 115us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117469.779163:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 8 00000100:00100000:3.0:1789117469.779907:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362411904 00000100:00100000:3.0:1789117469.779915:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362411904 00000100:00100000:3.0:1789117469.779958:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 132 00000100:00100000:3.0:1789117469.780065:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0216940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+22:10769:x1876025362411904:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789117469.780128:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e57f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117469.780143:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e57f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117469.780166:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e57f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117469.780339:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e57f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117469.780347:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e57f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117469.780353:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e57f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117469.780358:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117469.780362:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e57f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117469.780369:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e57f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117469.780378:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:3.0:1789117469.780381:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789117469.780384:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e57f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117469.780390:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e57f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117469.782234:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0216940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+23:10769:x1876025362411904:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 Request processed in 2258us (3544us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789117469.782251:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 132 00000100:00100000:3.0:1789117469.786380:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117469.787148:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362412288 00000100:00100000:0.0:1789117469.787160:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362412288 00000100:00100000:0.0:1789117469.787217:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 34 00000100:00100000:0.0:1789117469.787227:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+23:10769:x1876025362412288:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789117469.787495:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+24:10769:x1876025362412288:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 Request processed in 268us (1122us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789117469.787505:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 34 00000040:00080000:2.0:1789117469.792157:0:12082:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789117469.792163:0:12082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789117469.792673:0:12082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789117469.792682:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789117470.535542:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117471.385937:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117471.385970:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117471.386016:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117471.386039:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117471.386075:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117471.386163:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362412928 00000100:00100000:3.0:1789117471.386173:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362412928 00000100:00100000:3.0:1789117471.386226:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362412544 00000100:00100000:3.0:1789117471.386229:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362412544 00000100:00100000:3.0:1789117471.386254:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 130 00000100:00100000:3.0:1789117471.386264:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362412928:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117471.386330:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362412928:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 67us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117471.386338:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 130 00000100:00100000:3.0:1789117471.386355:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 131 00000100:00100000:3.0:1789117471.386361:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+24:2351:x1876025362412544:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117471.386389:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+24:2351:x1876025362412544:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 28us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117471.386396:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 131 00000100:00080000:3.0:1789117471.386447:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117471.387570:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362412416 00000100:00100000:3.0:1789117471.387579:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362412416 00000100:00100000:3.0:1789117471.387626:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 310 00000100:00100000:3.0:1789117471.387635:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2351:x1876025362412416:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117471.390594:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362412672 00000100:00100000:0.0:1789117471.390607:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362412672 00000100:00100000:0.0:1789117471.390702:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362412800 00000100:00100000:0.0:1789117471.390706:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362412800 00000100:00100000:3.0:1789117471.390949:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2351:x1876025362412416:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 3309us (5014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117471.390972:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 310 00000100:00080000:1.0:1789117471.391175:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117471.391180:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117471.391314:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 70 00000100:00100000:2.0:1789117471.391331:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0216580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362412672:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117471.391425:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0216580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362412672:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 98us (5453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117471.391432:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 70 00000100:00100000:0.0:1789117471.394828:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 71 00000100:00100000:0.0:1789117471.394844:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+5:2351:x1876025362412800:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117471.395099:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+5:2351:x1876025362412800:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 260us (9023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117471.395107:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 71 00000040:00080000:1.0:1789117471.432718:0:12502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789117471.432728:0:12502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789117471.432777:0:12502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789117471.432783:0:12502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789117471.564014:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117471.610572:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117471.610653:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362413184 00000100:00100000:3.0:1789117471.610663:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362413184 00000100:00100000:3.0:1789117471.610723:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 133 00000100:00100000:3.0:1789117471.610735:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+24:10789:x1876025362413184:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:3.0:1789117471.610762:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117471.610781:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e586 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c966 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117471.610888:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e58d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117471.610902:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e58d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117471.610914:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e58d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117471.610925:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789117471.611061:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e586 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c966 expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117471.611079:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e58d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c966 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117471.611087:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:3.0:1789117471.611090:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789117471.611093:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685200, rc 0) 00000100:00100000:3.0:1789117471.611145:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+26:10789:x1876025362413184:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 413us (582us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789117471.611152:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 133 00000100:00100000:3.0:1789117471.613501:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117471.613639:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362413312 00000100:00100000:0.0:1789117471.613654:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362413312 00000100:00100000:0.0:1789117471.613698:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 134 00000100:00100000:0.0:1789117471.613706:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+26:10789:x1876025362413312:12345-192.168.206.37@tcp:54:lfs.0 00010000:00010000:0.0:1789117471.613758:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460e59b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117471.613774:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460e59b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117471.613784:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460e59b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117471.613807:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460e59b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117471.613813:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460e59b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117471.613820:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460e59b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117471.613825:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbda00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117471.613829:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460e59b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117471.613836:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460e59b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117471.613847:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:0.0:1789117471.613850:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789117471.613854:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460e59b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117471.613886:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460e59b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117471.613946:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+26:10789:x1876025362413312:12345-192.168.206.37@tcp:54:lfs.0 Request processed in 241us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117471.613954:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 134 00000100:00100000:3.0:1789117471.703667:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117471.703827:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362413440 00000100:00100000:0.0:1789117471.703836:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362413440 00000100:00100000:0.0:1789117471.703893:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 46 00000100:00100000:0.0:1789117471.703903:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+6:2349:x1876025362413440:12345-192.168.206.37@tcp:101:cat.0 00010000:00010000:0.0:1789117471.703922:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117471.703940:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfa458fd/0xf7565228e460e5a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c96d expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789117471.703975:0:8269:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3c41a, atime: 0x6aa3c41a, ctime: 0x6aa3c41a, blocks: 0xb 00010000:00010000:0.0:1789117471.703993:0:8269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=318s v=(0 0) 00010000:00010000:0.0:1789117471.703998:0:8269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117471.704016:0:8269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfa458fd/0xf7565228e460e5a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c96d expref: 7 pid: 8269 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117471.704035:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bfa458fd/0xf7565228e460e5a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c96d expref: 7 pid: 8269 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117471.704048:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbda00, rc 0) 00000100:00100000:0.0:1789117471.704101:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+7:2349:x1876025362413440:12345-192.168.206.37@tcp:101:cat.0 Request processed in 199us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117471.704123:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 46 00000100:00100000:0.0:1789117471.715302:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117471.715348:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362413568 00000100:00100000:0.0:1789117471.715356:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362413568 00002000:00100000:0.0:1789117471.715434:0:6691:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9c17b7f09e00 x1876025362413568/t0(0) o3->e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp:22/0 lens 488/0 e 0 to 0 dl 1789117482 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789117471.715445:0:6691:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c17b7f09e00 with x1876025362413568 ext(0->4095) 00002000:00010000:0.0:1789117471.715450:0:6691:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c17b7f09e00 00000100:00100000:0.0:1789117471.715475:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 3 00000100:00100000:0.0:1789117471.715485:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e0c4e520-7af6-449d-969f-b46035974613+7:2352:x1876025362413568:12345-192.168.206.37@tcp:3:cat.0 00000100:00100000:0.0:1789117471.715816:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e0c4e520-7af6-449d-969f-b46035974613+7:2352:x1876025362413568:12345-192.168.206.37@tcp:3:cat.0 Request processed in 331us (521us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789117471.715824:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 3 00002000:00100000:0.0:1789117471.715832:0:6691:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9c17b7f09e00 x1876025362413568/t0(0) o3->e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp:22/0 lens 488/4536 e 0 to 0 dl 1789117482 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789117471.715838:0:6691:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c17b7f09e00 with x1876025362413568 ext(0->4095) 00002000:00010000:0.0:1789117471.715841:0:6691:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c17b7f09e00 00000100:00100000:3.0:1789117472.325601:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c16822b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385490560:0@lo:400:kworker.0 00000100:00100000:0.0:1789117472.325610:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7c92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385490304:0@lo:400:kworker.0 00000100:00100000:2.0:1789117472.325733:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7c90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385490432:0@lo:400:kworker.0 00000100:00100000:1.0:1789117472.326209:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c16822b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385490688:0@lo:400:kworker.0 00000100:00100000:0.0:1789117472.326553:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117472.326609:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c16822b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876025385490816:0@lo:400:kworker.0 00000100:00100000:0.0:1789117472.326637:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117472.326680:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385490304 00000100:00100000:0.0:1789117472.326686:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385490304 00000100:00100000:0.0:1789117472.326726:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789117472.326750:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385490304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117472.326801:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385490304:12345-0@lo:400:kworker.0 Request processed in 53us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117472.326808:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789117472.326838:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385490816 00000100:00100000:0.0:1789117472.326841:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385490816 00000100:00100000:0.0:1789117472.326876:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789117472.326887:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876025385490816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117472.326888:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117472.326919:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c16822b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385490944:0@lo:400:kworker.0 00000100:00100000:0.0:1789117472.326932:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876025385490816:12345-0@lo:400:kworker.0 Request processed in 48us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117472.326939:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789117472.326952:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385490432 00000100:00100000:0.0:1789117472.326955:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385490432 00000100:00100000:2.0:1789117472.326966:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117472.326980:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789117472.326988:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385490432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117472.327023:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385490944 00000100:00100000:2.0:1789117472.327028:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385490944 00000100:00100000:0.0:1789117472.327040:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385490432:12345-0@lo:400:kworker.0 Request processed in 52us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117472.327048:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789117472.327068:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1789117472.327076:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117472.327077:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681487c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385490944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117472.327085:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789117472.327085:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117472.327111:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681487c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385490944:12345-0@lo:400:kworker.0 Request processed in 36us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117472.327124:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789117472.327135:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385490688 00000100:00100000:2.0:1789117472.327138:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385490688 00000100:00100000:3.0:1789117472.327148:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117472.327172:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789117472.327180:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3299:x1876025385490688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117472.327196:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385490560 00000100:00100000:3.0:1789117472.327200:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385490560 00000100:00100000:0.0:1789117472.327220:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7c92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385490304:0@lo:400:kworker.0 00000100:00100000:2.0:1789117472.327229:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3299:x1876025385490688:12345-0@lo:400:kworker.0 Request processed in 47us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117472.327236:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c16822b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876025385490816:0@lo:400:kworker.0 00000100:00100000:2.0:1789117472.327240:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789117472.327243:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789117472.327255:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385490560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117472.327270:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c16822b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385490688:0@lo:400:kworker.0 00000100:00080000:2.0:1789117472.327276:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789117472.327280:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117472.327300:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7c90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385490432:0@lo:400:kworker.0 00000100:00100000:3.0:1789117472.327311:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385490560:12345-0@lo:400:kworker.0 Request processed in 57us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117472.327312:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1789117472.327319:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000100:00100000:3.0:1789117472.327324:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000004:00080000:2.0:1789117472.327340:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c17b7f0f840, transno 4294967301 00000004:00080000:2.0:1789117472.327356:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1789117472.327368:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c17b885e940, transno 4294967304 00000100:00100000:0.0:1789117472.327368:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c16822b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385490560:0@lo:400:kworker.0 00000100:00100000:2.0:1789117472.327379:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c16822b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385490944:0@lo:400:kworker.0 00010000:00010000:1.0:1789117472.581760:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117472.837601:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0214b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385491072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117472.837668:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117472.837765:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385491072 00000100:00100000:1.0:1789117472.837772:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385491072 00000100:00100000:1.0:1789117472.837824:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789117472.837833:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385491072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117472.837866:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117472.838226:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385491072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 393us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117472.838234:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789117472.841455:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0214b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385491072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117472.841620:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789117472.841631:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b885f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385491200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117472.841768:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117472.843013:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385491200 00000100:00100000:1.0:1789117472.843023:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385491200 00000100:00100000:1.0:1789117472.843073:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789117472.843082:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1876025385491200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117472.843116:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117472.843180:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1876025385491200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117472.843187:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789117472.843235:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b885f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385491200:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789117473.606578:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789117473.936632:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:1.0:1789117473.936653:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c17b7f43e40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789117473.936658:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1787241700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c17b7f43000 00000020:00080000:1.0:1789117473.936662:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1787241a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c17c0aad800 00000020:00080000:1.0:1789117473.936702:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1789117473.936711:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000001:00080000:0.0:1789117473.938173:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1789117473.938196:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1789117473.938203:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000020:00080000:2.0:1789117473.941495:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1789117473.941930:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1789117474.630212:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117475.653660:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117475.691615:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117475.692007:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362413696 00000100:00100000:0.0:1789117475.692017:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362413696 00000100:00100000:0.0:1789117475.692099:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 135 00000100:00100000:0.0:1789117475.692111:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0214b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+13:10442:x1876025362413696:12345-192.168.206.37@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789117475.692205:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0214b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+13:10442:x1876025362413696:12345-192.168.206.37@tcp:60:lhsmtool_posix.0 Request processed in 97us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117475.692213:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 135 00000100:00080000:2.0:1789117475.692435:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117475.696655:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117475.696752:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362413952 00000100:00100000:1.0:1789117475.696760:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362413952 00000100:00100000:1.0:1789117475.696817:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 35 00000100:00100000:1.0:1789117475.696826:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+13:10442:x1876025362413952:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789117475.697735:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+14:10442:x1876025362413952:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 Request processed in 905us (1083us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789117475.697744:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 35 00000100:00100000:0.0:1789117475.942196:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117475.942290:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362414080 00000100:00100000:1.0:1789117475.942299:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362414080 00000100:00100000:1.0:1789117475.942379:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 136 00000100:00100000:1.0:1789117475.942391:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:11241:x1876025362414080:12345-192.168.206.37@tcp:101:lsof.0 00010000:00010000:1.0:1789117475.942438:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117475.942506:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e5a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c974 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117475.942567:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e5b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117475.942581:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117475.942593:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117475.942792:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789117475.942804:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789117475.942906:0:5839:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117475.942931:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e5a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c974 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117475.942949:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c974 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117475.942957:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9ef00) 00010000:00010000:1.0:1789117475.942960:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789117475.942963:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442fe00, rc 0) 00000100:00100000:1.0:1789117475.943038:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:11241:x1876025362414080:12345-192.168.206.37@tcp:101:lsof.0 Request processed in 650us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117475.943046:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 136 00000100:00080000:2.0:1789117475.943691:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117476.504038:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117476.504084:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117476.504118:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117476.504217:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117476.504268:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362414464 00000100:00100000:0.0:1789117476.504277:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362414464 00000100:00100000:0.0:1789117476.504356:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 74 00000100:00100000:0.0:1789117476.504366:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0141e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362414464:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117476.504460:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0141e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362414464:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 96us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117476.504468:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 74 00000100:00080000:0.0:1789117476.504495:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117476.504735:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362414208 00000100:00100000:2.0:1789117476.504740:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362414208 00000100:00100000:2.0:1789117476.504778:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 312 00000100:00100000:2.0:1789117476.504786:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2351:x1876025362414208:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117476.504821:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2351:x1876025362414208:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 36us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117476.504827:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 312 00000100:00100000:1.0:1789117476.510814:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362414720 00000100:00100000:1.0:1789117476.510828:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362414720 00000100:00100000:2.0:1789117476.510856:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362414336 00000100:00100000:2.0:1789117476.510863:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362414336 00000100:00100000:3.0:1789117476.510937:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117476.510996:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362414592 00000100:00100000:3.0:1789117476.511001:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362414592 00000100:00100000:3.0:1789117476.511041:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 75 00000100:00100000:3.0:1789117476.511051:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0141680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+5:2351:x1876025362414592:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117476.511114:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0141680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+5:2351:x1876025362414592:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 64us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117476.511122:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 75 00000100:00100000:1.0:1789117476.511238:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 135 00000100:00100000:1.0:1789117476.511258:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0142940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:2351:x1876025362414720:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117476.511269:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 136 00000100:00100000:3.0:1789117476.511281:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0142580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+14:2351:x1876025362414336:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117476.511297:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0142940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:2351:x1876025362414720:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 41us (7177us total) trans 0 rc 0/0 00000100:00080000:2.0:1789117476.511301:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789117476.511306:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 135 00000100:00100000:3.0:1789117476.511595:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0142580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+14:2351:x1876025362414336:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 315us (7376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117476.511603:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 136 00010000:00010000:1.0:1789117476.681302:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117477.445677:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c16822b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385491712:0@lo:400:kworker.0 00000100:00100000:0.0:1789117477.445745:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117477.445790:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c16822b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385491584:0@lo:400:kworker.0 00000100:00100000:1.0:1789117477.445830:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117477.445870:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385491584 00000100:00100000:1.0:1789117477.445876:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385491584 00000100:00100000:0.0:1789117477.445895:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385491712 00000100:00100000:0.0:1789117477.445901:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385491712 00000100:00100000:1.0:1789117477.445943:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789117477.445946:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789117477.445960:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385491584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117477.445960:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385491712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117477.446040:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385491712:12345-0@lo:400:kworker.0 Request processed in 85us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117477.446048:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385491584:12345-0@lo:400:kworker.0 Request processed in 93us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117477.446050:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789117477.446061:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1789117477.446091:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789117477.446096:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117477.446103:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1789117477.446109:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c17b87aed00, transno 4294967310 00000004:00080000:0.0:1789117477.446121:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1789117477.446141:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c16822b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385491712:0@lo:400:kworker.0 00000100:00100000:3.0:1789117477.446244:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c16822b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385491456:0@lo:400:kworker.0 00000100:00100000:3.0:1789117477.446278:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117477.446300:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c16822b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385491968:0@lo:400:kworker.0 00000100:00100000:3.0:1789117477.446328:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117477.446368:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789117477.446375:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c16822b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385491328:0@lo:400:kworker.0 00000100:00100000:3.0:1789117477.446419:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117477.446441:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c16822b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876025385491840:0@lo:400:kworker.0 00000100:00100000:3.0:1789117477.446463:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117477.446540:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c16822b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385491584:0@lo:400:kworker.0 00000100:00100000:1.0:1789117477.446568:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385491456 00000100:00100000:1.0:1789117477.446573:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385491456 00000100:00100000:1.0:1789117477.446600:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385491840 00000100:00100000:1.0:1789117477.446603:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385491840 00000100:00100000:2.0:1789117477.446607:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385491328 00000100:00100000:2.0:1789117477.446614:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385491328 00000100:00100000:1.0:1789117477.446633:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789117477.446642:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385491456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117477.446651:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789117477.446662:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3301:x1876025385491328:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789117477.447014:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117477.447029:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789117477.447037:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876025385491840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117477.450017:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385491456:12345-0@lo:400:kworker.0 Request processed in 3367us (3729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117477.450033:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789117477.451619:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385491968 00000100:00100000:2.0:1789117477.451836:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3301:x1876025385491328:12345-0@lo:400:kworker.0 Request processed in 5169us (5408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117477.451866:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789117477.451956:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c16822b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385491328:0@lo:400:kworker.0 00000100:00100000:3.0:1789117477.451993:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385491968 00000100:00100000:3.0:1789117477.452055:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789117477.452064:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385491968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117477.452128:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385491968:12345-0@lo:400:kworker.0 Request processed in 65us (5803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117477.452140:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1789117477.452389:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789117477.452511:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876025385491840:12345-0@lo:400:kworker.0 Request processed in 5473us (6044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117477.452521:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789117477.452594:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c16822b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876025385491840:0@lo:400:kworker.0 00000100:00100000:2.0:1789117477.452608:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c16822b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385491456:0@lo:400:kworker.0 00000100:00100000:2.0:1789117477.452618:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c16822b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385491968:0@lo:400:kworker.0 00010000:00010000:1.0:1789117477.703329:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117477.958049:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789117477.958072:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b885e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385492096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117477.958142:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117477.958301:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385492096 00000100:00100000:1.0:1789117477.958310:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385492096 00000100:00100000:1.0:1789117477.958359:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789117477.958369:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385492096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117477.958422:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117477.958479:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385492096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117477.958487:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789117477.958569:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b885e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385492096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117477.960787:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385492224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117477.960856:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117477.962205:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385492224 00000100:00100000:1.0:1789117477.962215:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385492224 00000100:00100000:1.0:1789117477.962271:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789117477.962280:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681484b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385492224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117477.962327:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117477.962431:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681484b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385492224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117477.962438:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789117477.962572:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385492224:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1789117478.021882:0:12082:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789117478.021891:0:12082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789117478.022213:0:12082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1789117478.022221:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789117478.725656:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789117479.086928:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1789117479.086943:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789117479.087127:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789117479.087139:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:2.0:1789117479.445155:0:12707:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 05:04:36 (1789117476) 00010000:00010000:1.0:1789117479.749746:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117480.471042:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117480.471145:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362414976 00000100:00100000:3.0:1789117480.471155:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362414976 00000100:00100000:3.0:1789117480.471236:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 137 00000100:00100000:3.0:1789117480.471248:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+13:11506:x1876025362414976:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789117480.471267:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117480.471285:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e5b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c97b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.471367:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e5be lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.471381:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e5be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.471393:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e5be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.471476:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e5c5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.471484:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.471491:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789117480.471951:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789117480.472319:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e5cc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.472331:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e5cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.472340:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e5cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117480.472350:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1789117480.472575:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e5be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.472583:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e5be lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.472597:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e5be lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.472604:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685400 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117480.472607:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e5be lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.472613:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e5be lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.472624:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c1788d9e300) 00010000:00010000:3.0:1789117480.472627:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117480.472632:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e5be lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.472637:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e5be lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.472649:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.472654:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e5c5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.472659:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.472662:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781684c00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117480.472665:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.472681:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e5c5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.472691:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c1782df4f00) 00010000:00010000:3.0:1789117480.472693:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117480.472696:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e5c5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.472701:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e5c5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.474517:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e5b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c97b expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.474542:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e5cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c97b expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117480.474550:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1788d9e000) 00010000:00010000:3.0:1789117480.474552:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117480.474556:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781684000, rc 0) 00000100:00100000:3.0:1789117480.474683:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+15:11506:x1876025362414976:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 3438us (3649us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789117480.474692:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 137 00000100:00100000:0.0:1789117480.485713:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117480.485758:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117480.485970:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362415232 00000100:00100000:2.0:1789117480.485983:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362415232 00000100:00100000:1.0:1789117480.485994:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362415104 00000100:00100000:1.0:1789117480.486000:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362415104 00000100:00100000:1.0:1789117480.486049:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 138 00000100:00100000:2.0:1789117480.486060:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 9 00000100:00100000:1.0:1789117480.486062:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+16:11506:x1876025362415104:12345-192.168.206.37@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789117480.486074:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+16:2349:x1876025362415232:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117480.486090:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117480.486115:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684000/0xf7565228e460e5cc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c97b expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117480.486133:0:7638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1788d9e000) 00010000:00010000:2.0:1789117480.486139:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117480.486171:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+15:11506:x1876025362415104:12345-192.168.206.37@tcp:59:lhsmtool_posix.0 Request processed in 112us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117480.486185:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 138 00000100:00100000:2.0:1789117480.489138:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+14:2349:x1876025362415232:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 3059us (3369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117480.489168:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 9 00010000:00010000:2.0:1789117480.773973:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789117481.093718:0:12082:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789117481.093727:0:12082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789117481.093774:0:12082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1789117481.093781:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789117481.626082:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117481.626126:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117481.626160:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117481.626194:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117481.626220:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117481.626307:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362415616 00000100:00100000:2.0:1789117481.626317:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362415616 00000100:00100000:3.0:1789117481.626364:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362415872 00000100:00100000:3.0:1789117481.626368:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362415872 00000100:00100000:2.0:1789117481.626379:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362415744 00000100:00100000:2.0:1789117481.626381:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362415744 00000100:00100000:2.0:1789117481.626425:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 78 00000100:00100000:2.0:1789117481.626435:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+6:2352:x1876025362415616:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117481.626440:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362415488 00000100:00100000:3.0:1789117481.626442:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362415488 00000100:00100000:3.0:1789117481.626463:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 140 00000100:00100000:3.0:1789117481.626483:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:2352:x1876025362415872:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117481.626505:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+6:2352:x1876025362415616:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 72us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117481.626510:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:2352:x1876025362415872:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 28us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117481.626513:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 78 00000100:00100000:3.0:1789117481.626516:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 140 00000100:00100000:3.0:1789117481.626529:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 141 00000100:00100000:2.0:1789117481.626529:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 79 00000100:00100000:3.0:1789117481.626536:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+14:2352:x1876025362415488:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117481.626536:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+5:2352:x1876025362415744:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117481.626557:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+14:2352:x1876025362415488:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 22us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117481.626558:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+5:2352:x1876025362415744:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 24us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117481.626563:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 141 00000100:00100000:2.0:1789117481.626564:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 79 00000100:00080000:1.0:1789117481.626871:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117481.626876:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117481.626878:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117481.626960:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362415360 00000100:00100000:0.0:1789117481.626965:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362415360 00000100:00100000:0.0:1789117481.627004:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 314 00000100:00100000:0.0:1789117481.627011:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2352:x1876025362415360:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117481.627057:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2352:x1876025362415360:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 46us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117481.627072:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 314 00010000:00010000:2.0:1789117481.800196:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117482.330194:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117482.331387:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362416000 00000100:00100000:1.0:1789117482.331424:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362416000 00000100:00100000:1.0:1789117482.331617:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 139 00000100:00100000:1.0:1789117482.331627:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681484f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+14:11548:x1876025362416000:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117482.331646:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117482.331665:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e5da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c982 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.331725:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e5e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.331738:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e5e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.331751:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e5e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.331766:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e5e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.331772:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.331778:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.332066:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e5e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.332074:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e5e1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.332090:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.332096:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ea00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117482.332100:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.332107:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e5e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.332118:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9ef00) 00010000:00010000:1.0:1789117482.332121:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117482.332126:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e5e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.332132:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e5e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.332144:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.332148:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e5e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.332153:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e5e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.332158:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117482.332161:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e5e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.332176:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e5e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.332183:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c1788d9e600) 00010000:00010000:1.0:1789117482.332185:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117482.332188:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e5e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.332193:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e5e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.332224:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e5da lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c982 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.332234:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9ef00) 00010000:00010000:1.0:1789117482.332236:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117482.332240:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e5da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c982 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.332248:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e800, rc 0) 00000100:00080000:2.0:1789117482.332358:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117482.333661:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681484f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+14:11548:x1876025362416000:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 2029us (3470us total) trans 0 rc 301/301 00000100:00100000:1.0:1789117482.333672:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 139 00000100:00100000:2.0:1789117482.340283:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117482.340352:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362416256 00000100:00100000:3.0:1789117482.340362:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362416256 00000100:00100000:3.0:1789117482.340599:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 140 00000100:00100000:3.0:1789117482.340610:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681486940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+14:11548:x1876025362416256:12345-192.168.206.37@tcp:36:lfs.0 00010000:00010000:3.0:1789117482.340660:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117482.340696:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fc00/0xf7565228e460df58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7bb expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.340713:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9ef00) 00010000:00010000:3.0:1789117482.340718:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789117482.340989:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e5ef lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.341004:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e5b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c974 expref: 5 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.341013:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e5ef lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.341053:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c974 expref: 5 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.341067:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e5b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c974 expref: 5 pid: 5839 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117482.341081:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f0c780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876025385492352:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117482.341160:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178720ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117482.350759:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117482.350876:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f0c780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876025385492352:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117482.350902:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e5ef lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117482.350983:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362416384 00000100:00100000:0.0:1789117482.350989:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362416384 00010000:00010000:0.0:1789117482.351022:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e5b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c974 expref: 6 pid: 5839 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117482.351062:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 65 00000100:00100000:0.0:1789117482.351071:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:2350:x1876025362416384:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117482.351084:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117482.351089:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e5b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c974 expref: 6 pid: 5839 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.351101:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c974 expref: 6 pid: 5839 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.351121:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e5b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c974 expref: 6 pid: 5839 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.351135:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9ef00) 00010000:00010000:0.0:1789117482.351140:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e5ef lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.351158:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e5ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.351166:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e5ef lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.351194:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117482.351240:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2350:x1876025362416384:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 170us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117482.351247:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 65 00010000:00010000:2.0:1789117482.352643:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e5ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.352664:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e5ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.352687:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e5f6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.352697:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.352705:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117482.353790:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1789117482.353802:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e5ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.353811:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e5ef lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.353818:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e5ef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.353823:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117482.353828:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e5ef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.353835:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e5ef lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.353847:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9ef00) 00010000:00010000:2.0:1789117482.353850:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117482.353860:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e5ef lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.353867:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e5ef lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789117482.353883:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003f509dd8 reply state 00000000f434db7a transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117482.353891:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789117482.353995:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681486940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+15:11548:x1876025362416256:12345-192.168.206.37@tcp:36:lfs.0 Request processed in 13384us (13715us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1789117482.354004:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 140 00010000:00010000:2.0:1789117482.357729:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.357746:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e5f6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.357754:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e5f6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.357760:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e400 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117482.357765:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e5f6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.357774:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e5f6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.357790:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c1783e89a00) 00010000:00010000:2.0:1789117482.357793:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117482.357798:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e5f6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.357811:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e5f6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117482.442820:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117482.442936:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362416512 00000100:00100000:1.0:1789117482.442956:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362416512 00000100:00100000:1.0:1789117482.443022:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 141 00000100:00100000:1.0:1789117482.443033:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+14:11556:x1876025362416512:12345-192.168.206.37@tcp:101:lctl.0 00010000:00010000:1.0:1789117482.443071:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117482.443094:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e5fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c989 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.443155:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e604 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.443169:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e604 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.443180:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e604 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117482.443235:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789117482.443239:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1789117482.443262:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e604 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.443285:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e5fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c989 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.443305:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e604 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c989 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.443313:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9e600) 00010000:00010000:1.0:1789117482.443316:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789117482.443320:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e000, rc 0) 00000100:00100000:1.0:1789117482.443388:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+15:11556:x1876025362416512:12345-192.168.206.37@tcp:101:lctl.0 Request processed in 356us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117482.443395:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 141 00000100:00100000:1.0:1789117482.488521:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117482.488696:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362416640 00000100:00100000:0.0:1789117482.488707:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362416640 00000100:00100000:0.0:1789117482.488781:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 142 00000100:00100000:0.0:1789117482.488791:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+15:11562:x1876025362416640:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:0.0:1789117482.488810:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117482.488829:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e60b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c990 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.488889:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e612 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.489129:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e612 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.489143:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e612 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.489159:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e619 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.489180:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.489186:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.489294:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e620 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.489303:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.489310:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117482.489338:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1789117482.489342:0:7242:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789117482.489365:0:7242:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.489376:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e612 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.489382:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e612 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.489388:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e612 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.489395:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117482.490116:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e612 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.490139:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e612 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.490153:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9e600) 00010000:00010000:0.0:1789117482.490157:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117482.490162:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e612 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.490169:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e612 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.490184:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.490194:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e619 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.490202:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e619 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.490206:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbca00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117482.490209:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e619 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.490214:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e619 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.490221:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c1782c0ed00) 00010000:00010000:0.0:1789117482.490223:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117482.490225:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e619 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.490239:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e619 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.490340:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e60b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c990 expref: 17 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.490354:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c990 expref: 16 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.490361:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:0.0:1789117482.490363:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789117482.490365:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbdc00, rc 0) 00000100:00100000:1.0:1789117482.490711:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+16:11562:x1876025362416640:12345-192.168.206.37@tcp:101:bash.0 Request processed in 1919us (2196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117482.490720:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 142 00000100:00100000:0.0:1789117482.493389:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117482.494083:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362416896 00000100:00100000:1.0:1789117482.494093:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362416896 00000100:00100000:1.0:1789117482.494149:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 143 00000100:00100000:1.0:1789117482.494159:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+16:11562:x1876025362416896:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:1.0:1789117482.494177:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117482.494196:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e627 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c997 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.494331:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e62e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.494345:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e62e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.494356:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e62e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.495048:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e635 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.495060:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.495068:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789117482.496340:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789117482.496814:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e63c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.496827:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e63c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.496838:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e63c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.496872:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e62e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.496879:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e62e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.496885:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e62e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.496892:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ea00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117482.497027:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e62e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.497037:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e62e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.497049:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:1.0:1789117482.497052:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117482.497057:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e62e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.497063:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e62e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789117482.497089:0:5841:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003ff54248 reply state 000000000fa8db96 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117482.497096:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789117482.497129:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e627 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c997 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.497143:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e63c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c997 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.497150:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9ea00) 00010000:00010000:1.0:1789117482.497153:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117482.497155:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442ec00, rc 0) 00000100:00100000:1.0:1789117482.497298:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+19:11562:x1876025362416896:12345-192.168.206.37@tcp:101:bash.0 Request processed in 3140us (3916us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1789117482.497308:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 143 00000100:00100000:0.0:1789117482.506159:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117482.506239:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362417024 00000100:00100000:1.0:1789117482.506249:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362417024 00000100:00100000:1.0:1789117482.506317:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 47 00000100:00100000:1.0:1789117482.506327:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+5:2350:x1876025362417024:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:1.0:1789117482.506344:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117482.506365:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005955b911/0xf7565228e460e64a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c99e expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789117482.506391:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789117482.506433:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=329s v=(0 0) 00010000:00010000:1.0:1789117482.506449:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117482.506459:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005955b911/0xf7565228e460e64a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c99e expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.506477:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005955b911/0xf7565228e460e64a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c99e expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.506491:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e400, rc 0) 00000100:00100000:1.0:1789117482.506537:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+6:2350:x1876025362417024:12345-192.168.206.37@tcp:101:bash.0 Request processed in 212us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117482.506545:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 47 00010000:00010000:3.0:1789117482.508516:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.508534:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e635 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.508542:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e635 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.508548:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117482.508554:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e635 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.508563:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e635 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.508588:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c1788d9e700) 00010000:00010000:3.0:1789117482.508604:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117482.508610:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e635 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.508616:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e635 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117482.509485:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117482.509607:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362417152 00000100:00100000:3.0:1789117482.509616:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362417152 00000100:00100000:3.0:1789117482.509660:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 48 00000100:00100000:3.0:1789117482.509671:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681486d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+6:11562:x1876025362417152:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:3.0:1789117482.509689:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117482.509705:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b65b36ee/0xf7565228e460e651 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c9a5 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.509733:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005955b911/0xf7565228e460e64a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c99e expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.509741:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117482.509746:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117482.509751:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b65b36ee/0xf7565228e460e651 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9a5 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.509782:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005955b911/0xf7565228e460e64a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c99e expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.509796:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005955b911/0xf7565228e460e64a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c99e expref: 7 pid: 6687 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117482.509827:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f0c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6686:1876025385492480:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117482.511114:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178720ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117482.513336:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117482.513479:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f0c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6686:1876025385492480:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117482.513518:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b65b36ee/0xf7565228e460e651 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9a5 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.513542:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781684c00, rc 0) 00000100:00100000:3.0:1789117482.513615:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681486d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+7:11562:x1876025362417152:12345-192.168.206.37@tcp:101:bash.0 Request processed in 3944us (4135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117482.513625:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 48 00000100:00100000:1.0:1789117482.514186:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362417280 00000100:00100000:1.0:1789117482.514194:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362417280 00010000:00010000:1.0:1789117482.514227:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005955b911/0xf7565228e460e64a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c99e expref: 7 pid: 6687 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117482.514264:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 66 00000100:00100000:1.0:1789117482.514274:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17845e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+7:2350:x1876025362417280:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117482.514289:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117482.514316:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005955b911/0xf7565228e460e64a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c99e expref: 7 pid: 6687 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.514329:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005955b911/0xf7565228e460e64a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c99e expref: 7 pid: 6687 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.514352:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005955b911/0xf7565228e460e64a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c99e expref: 7 pid: 6687 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.514381:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117482.514386:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117482.514394:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b65b36ee/0xf7565228e460e651 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9a5 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.514438:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b65b36ee/0xf7565228e460e651 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9a5 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.514470:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b65b36ee/0xf7565228e460e651 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9a5 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117482.514483:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b885f840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5827:1876025385492608:192.168.206.37@tcp:105: 00000100:00100000:1.0:1789117482.514553:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1784c2a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789117482.519381:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117482.519543:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b885f840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5827:1876025385492608:192.168.206.37@tcp:105: 00010000:00010000:1.0:1789117482.519580:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117482.519629:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17845e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+6:2350:x1876025362417280:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 5356us (6308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117482.519639:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 66 00000100:00100000:2.0:1789117482.519801:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362417536 00000100:00100000:2.0:1789117482.519807:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362417536 00000100:00100000:2.0:1789117482.519850:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 36 00000100:00100000:2.0:1789117482.519859:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+18:11562:x1876025362417536:12345-192.168.206.37@tcp:35:bash.0 00000100:00100000:2.0:1789117482.520177:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+19:11562:x1876025362417536:12345-192.168.206.37@tcp:35:bash.0 Request processed in 318us (806us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1789117482.520183:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 36 00000100:00100000:2.0:1789117482.565919:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385492736:0@lo:400:kworker.0 00000100:00100000:2.0:1789117482.566000:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117482.566042:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876025385493248:0@lo:400:kworker.0 00000100:00100000:2.0:1789117482.566067:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117482.566093:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789117482.566099:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385492864:0@lo:400:kworker.0 00000100:00100000:2.0:1789117482.566119:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117482.566133:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7af1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385493376:0@lo:400:kworker.0 00000100:00100000:2.0:1789117482.566152:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117482.566179:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385493120:0@lo:400:kworker.0 00000100:00100000:2.0:1789117482.566200:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117482.566216:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117482.566221:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f0cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385492992:0@lo:400:kworker.0 00000100:00100000:2.0:1789117482.566252:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117482.566294:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385493248 00000100:00100000:2.0:1789117482.566301:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385493248 00000100:00100000:2.0:1789117482.566342:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385492864 00000100:00100000:2.0:1789117482.566345:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385492864 00000100:00100000:2.0:1789117482.566354:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385492992 00000100:00100000:2.0:1789117482.566356:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385492992 00000100:00100000:2.0:1789117482.566369:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789117482.566376:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681484780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876025385493248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117482.566445:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681484780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876025385493248:12345-0@lo:400:kworker.0 Request processed in 69us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117482.566453:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789117482.566470:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789117482.566476:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681485a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385492864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117482.566501:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681485a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385492864:12345-0@lo:400:kworker.0 Request processed in 25us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117482.566507:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789117482.566517:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789117482.566523:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385492992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117482.566549:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385492992:12345-0@lo:400:kworker.0 Request processed in 26us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117482.566554:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:2.0:1789117482.566580:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117482.566608:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f0cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385492992:0@lo:400:kworker.0 00000100:00100000:2.0:1789117482.566633:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385492864:0@lo:400:kworker.0 00000100:00100000:2.0:1789117482.566641:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876025385493248:0@lo:400:kworker.0 00000100:00100000:2.0:1789117482.566669:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385493376 00000100:00100000:2.0:1789117482.566673:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385493376 00000100:00100000:2.0:1789117482.566703:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385493120 00000100:00100000:2.0:1789117482.566706:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385493120 00000100:00100000:2.0:1789117482.566726:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789117482.566733:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681485e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385493376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117482.566738:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385492736 00000100:00100000:3.0:1789117482.566745:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385492736 00000100:00100000:2.0:1789117482.566770:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681485e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385493376:12345-0@lo:400:kworker.0 Request processed in 37us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117482.566777:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789117482.566781:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789117482.566792:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1784521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385492736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117482.566796:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789117482.566806:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16814852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385493120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117482.566844:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1784521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385492736:12345-0@lo:400:kworker.0 Request processed in 54us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117482.566852:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16814852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385493120:12345-0@lo:400:kworker.0 Request processed in 47us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117482.566853:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789117482.566863:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1789117482.566880:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789117482.566883:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117482.566902:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385493120:0@lo:400:kworker.0 00000100:00100000:3.0:1789117482.566927:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7af1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385493376:0@lo:400:kworker.0 00000100:00100000:3.0:1789117482.567019:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385492736:0@lo:400:kworker.0 00000100:00100000:0.0:1789117482.575957:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117482.576175:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362417792 00000100:00100000:2.0:1789117482.576185:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362417792 00000100:00100000:2.0:1789117482.576297:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 144 00000100:00100000:2.0:1789117482.576308:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+19:11572:x1876025362417792:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:2.0:1789117482.576331:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117482.576351:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e658 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c9ac expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117482.576491:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1789117482.576618:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e658 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9ac expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.576645:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9e600) 00010000:00010000:2.0:1789117482.576648:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789117482.576654:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e658 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9ac expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.576667:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f800, rc 0) 00000100:00100000:2.0:1789117482.576716:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+20:11572:x1876025362417792:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 411us (778us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1789117482.576725:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 144 00000100:00100000:0.0:1789117482.579529:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117482.579866:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362418048 00000100:00100000:2.0:1789117482.579876:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362418048 00000100:00100000:2.0:1789117482.579932:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 37 00000100:00100000:2.0:1789117482.579951:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+20:11572:x1876025362418048:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:2.0:1789117482.580213:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+21:11572:x1876025362418048:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 271us (692us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1789117482.580222:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 37 00000100:00100000:0.0:1789117482.647975:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117482.648050:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362418176 00000100:00100000:1.0:1789117482.648060:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362418176 00000100:00100000:1.0:1789117482.648124:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 145 00000100:00100000:1.0:1789117482.648135:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+21:11578:x1876025362418176:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117482.648161:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117482.648183:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e666 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c9b3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.649323:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e66d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.649344:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e66d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.649355:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e66d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117482.649502:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1789117482.649506:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789117482.649541:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e66d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.649572:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e666 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9b3 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.649593:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e66d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9b3 expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.649602:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:1.0:1789117482.649605:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789117482.649609:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e800, rc 0) 00000100:00100000:1.0:1789117482.649690:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+22:11578:x1876025362418176:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 1556us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117482.649699:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 145 00000100:00100000:0.0:1789117482.658044:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117482.659002:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362418432 00000100:00100000:3.0:1789117482.659013:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362418432 00000100:00100000:2.0:1789117482.659224:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 146 00000100:00100000:2.0:1789117482.659235:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+22:11578:x1876025362418432:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:2.0:1789117482.659254:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117482.659285:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e674 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c9ba expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.659394:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e67b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.659448:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e67b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.659459:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e67b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117482.659472:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789117482.659598:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e674 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9ba expref: 25 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.659614:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e67b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9ba expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.659622:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9ea00) 00010000:00010000:2.0:1789117482.659624:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117482.659628:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457e800, rc 0) 00000100:00100000:2.0:1789117482.659897:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+24:11578:x1876025362418432:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 661us (1859us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1789117482.659906:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 146 00000100:00100000:0.0:1789117482.665390:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117482.665549:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362418688 00000100:00100000:2.0:1789117482.665743:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362418688 00000100:00100000:2.0:1789117482.666039:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 147 00000100:00100000:2.0:1789117482.666050:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+24:11578:x1876025362418688:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:2.0:1789117482.666073:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117482.666092:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e689 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c9c1 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.666199:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e690 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.666215:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e690 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.666225:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e690 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117482.666238:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789117482.666355:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e689 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9c1 expref: 27 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.666371:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e690 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9c1 expref: 26 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.666379:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9ea00) 00010000:00010000:2.0:1789117482.666382:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789117482.666385:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457e400, rc 0) 00000100:00100000:2.0:1789117482.666493:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+26:11578:x1876025362418688:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 445us (1113us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1789117482.666501:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 147 00000100:00100000:3.0:1789117482.667784:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117482.667954:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362418816 00000100:00100000:0.0:1789117482.667962:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362418816 00000100:00100000:0.0:1789117482.668017:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 10 00000100:00100000:0.0:1789117482.668028:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+26:2349:x1876025362418816:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117482.668041:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117482.668073:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e67b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9ba expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.668182:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9ea00) 00010000:00010000:0.0:1789117482.668187:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117482.668239:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+25:2349:x1876025362418816:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 212us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117482.668247:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 10 00000100:00100000:0.0:1789117482.672734:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117482.672811:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362418944 00000100:00100000:2.0:1789117482.672819:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362418944 00000100:00100000:2.0:1789117482.672874:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 49 00000100:00100000:2.0:1789117482.672884:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+6:2349:x1876025362418944:12345-192.168.206.37@tcp:1:lfs.0 00010000:00010000:2.0:1789117482.672926:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee6f0aed/0xf7565228e460e69e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.672965:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b65b36ee/0xf7565228e460e651 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9a5 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.672974:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117482.672978:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789117482.672982:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee6f0aed/0xf7565228e460e69e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.673016:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b65b36ee/0xf7565228e460e651 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9a5 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.673030:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b65b36ee/0xf7565228e460e651 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9a5 expref: 6 pid: 6686 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117482.673044:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681487480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1876025385493504:192.168.206.37@tcp:104: 00000100:00100000:2.0:1789117482.673146:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17852d19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117482.680464:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117482.680611:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681487480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1876025385493504:192.168.206.37@tcp:104: 00010000:00010000:1.0:1789117482.680640:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ee6f0aed/0xf7565228e460e69e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117482.680756:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362419072 00000100:00100000:0.0:1789117482.680764:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362419072 00002000:00100000:0.0:1789117482.680810:0:6691:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9c1681487840 x1876025362419072/t0(0) o4->e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp:33/0 lens 504/0 e 0 to 0 dl 1789117493 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789117482.680820:0:6691:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1681487840 with x1876025362419072 ext(0->12) 00010000:00010000:0.0:1789117482.680827:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b65b36ee/0xf7565228e460e651 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9a5 expref: 7 pid: 6686 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.680840:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b65b36ee/0xf7565228e460e651 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9a5 expref: 7 pid: 6686 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789117482.680848:0:6691:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c1681487840 00000100:00100000:0.0:1789117482.680880:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 2 00000100:00100000:0.0:1789117482.680889:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681487840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e0c4e520-7af6-449d-969f-b46035974613+7:2350:x1876025362419072:12345-192.168.206.37@tcp:4:lfs.0 00000100:00100000:0.0:1789117482.682802:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681487840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e0c4e520-7af6-449d-969f-b46035974613+9:2350:x1876025362419072:12345-192.168.206.37@tcp:4:lfs.0 Request processed in 1906us (2340us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789117482.682815:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 2 00002000:00100000:0.0:1789117482.682834:0:6691:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9c1681487840 x1876025362419072/t4294967305(0) o4->e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp:33/0 lens 504/448 e 0 to 0 dl 1789117493 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789117482.682843:0:6691:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1681487840 with x1876025362419072 ext(0->12) 00010000:00010000:0.0:1789117482.682853:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b65b36ee/0xf7565228e460e651 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9a5 expref: 9 pid: 6686 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.682869:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b65b36ee/0xf7565228e460e651 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9a5 expref: 9 pid: 6686 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789117482.682877:0:6691:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c1681487840 00000100:00100000:0.0:1789117482.691139:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117482.691324:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362419200 00000100:00100000:2.0:1789117482.691348:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362419200 00010000:00010000:2.0:1789117482.691393:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b65b36ee/0xf7565228e460e651 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9a5 expref: 9 pid: 6686 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117482.691481:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 67 00000100:00100000:2.0:1789117482.691491:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+9:2350:x1876025362419200:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117482.691506:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789117482.691540:0:7638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789117482.691543:0:7638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789117481 00002000:00010000:2.0:1789117482.691545:0:7638:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789117481 00002000:00010000:2.0:1789117482.691547:0:7638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789117481 00010000:00010000:2.0:1789117482.691554:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b65b36ee/0xf7565228e460e651 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9a5 expref: 9 pid: 6686 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.691568:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b65b36ee/0xf7565228e460e651 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9a5 expref: 9 pid: 6686 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.691590:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b65b36ee/0xf7565228e460e651 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9a5 expref: 9 pid: 6686 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.691606:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789117482.691610:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789117482.691616:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee6f0aed/0xf7565228e460e69e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.691626:0:7638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee6f0aed/0xf7565228e460e69e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.691740:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ee6f0aed/0xf7565228e460e69e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.691755:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee6f0aed/0xf7565228e460e69e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.691780:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee6f0aed/0xf7565228e460e69e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.691789:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee6f0aed/0xf7565228e460e69e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.691796:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee6f0aed/0xf7565228e460e69e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.691803:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f800 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117482.691807:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee6f0aed/0xf7565228e460e69e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.691815:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee6f0aed/0xf7565228e460e69e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.691828:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee6f0aed/0xf7565228e460e69e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.691841:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117482.691894:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+8:2350:x1876025362419200:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 403us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117482.691901:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 67 00010000:00010000:3.0:1789117482.691904:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee6f0aed/0xf7565228e460e69e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117482.691971:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+7:2349:x1876025362418944:12345-192.168.206.37@tcp:1:lfs.0 Request processed in 19089us (19245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117482.691979:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 49 00000100:00100000:2.0:1789117482.699117:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117482.699351:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362419456 00000100:00100000:0.0:1789117482.699360:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362419456 00000100:00100000:2.0:1789117482.699617:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 38 00000100:00100000:2.0:1789117482.699638:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a9731450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+25:11578:x1876025362419456:12345-192.168.206.37@tcp:35:lfs.0 00000004:00010000:2.0:1789117482.699702:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e690 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9c1 expref: 25 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789117482.700015:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1789117482.700063:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1789117482.700812:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1789117482.700872:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.700888:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e63c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c997 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.700981:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6a5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.701016:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e63c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c997 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.701032:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e63c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c997 expref: 29 pid: 5841 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117482.701045:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681486580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1876025385493632:192.168.206.37@tcp:104: 00000100:00100000:2.0:1789117482.701676:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17852d1900 going to sleep for 11 seconds 00000100:00100000:2.0:1789117482.705069:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681486580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1876025385493632:192.168.206.37@tcp:104: 00010000:00010000:2.0:1789117482.705109:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117482.705431:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117482.705580:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362419584 00000100:00100000:1.0:1789117482.705587:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362419584 00010000:00010000:1.0:1789117482.705622:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e63c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c997 expref: 30 pid: 5841 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117482.705660:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 68 00000100:00100000:1.0:1789117482.705669:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681486580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+30:2350:x1876025362419584:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117482.705683:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117482.705691:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e63c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c997 expref: 30 pid: 5841 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.705703:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e63c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c997 expref: 30 pid: 5841 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.705734:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e63c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c997 expref: 30 pid: 5841 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.705749:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9ea00) 00010000:00010000:1.0:1789117482.705754:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.705762:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.705770:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6a5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.705808:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117482.705826:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.705833:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117482.705870:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681486580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+29:2350:x1876025362419584:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 202us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117482.705877:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 68 00000001:00080000:2.0:1789117482.705957:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1789117482.706161:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1789117482.706473:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c16814861c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1876025385493760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789117482.706563:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117482.706585:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178303a780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117482.706688:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385493760 00000100:00100000:0.0:1789117482.706694:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385493760 00000100:00100000:0.0:1789117482.706733:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789117482.706741:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16814870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1876025385493760:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789117482.706819:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16814870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1876025385493760:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 75us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117482.706827:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789117482.706897:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c16814861c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1876025385493760:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789117482.707663:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1789117482.707727:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c16814861c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1876025385493888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789117482.707767:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117482.707851:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17852d1900 going to sleep for 11 seconds 00000100:00100000:3.0:1789117482.709853:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385493888 00000100:00100000:3.0:1789117482.709866:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385493888 00000100:00100000:2.0:1789117482.710062:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789117482.710072:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681485680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1876025385493888:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789117482.710590:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c16814861c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1876025385493888:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789117482.710667:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1789117482.710711:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.710721:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6a5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.710728:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.710734:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457fa00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117482.710738:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.710745:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6a5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.710759:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9ea00) 00010000:00010000:3.0:1789117482.710762:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789117482.710767:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6a5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117482.710773:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6a5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789117482.710979:0:5842:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789117482.711085:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1789117482.711096:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329840695184ns, next at 330840693416ns, rc = 0 00000001:00080000:3.0:1789117482.711102:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1789117482.711130:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9ea00) 00010000:00010000:3.0:1789117482.711134:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789117482.711141:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e690 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9c1 expref: 33 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117482.712869:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681485680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1876025385493888:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 259us (2562us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789117482.712884:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789117482.716328:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a9731450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+32:11578:x1876025362419456:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 16683us (17210us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1789117482.716341:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 38 00000020:00080000:0.0:1789117482.717067:0:5842:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789117482.719497:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117482.719584:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362419712 00000100:00100000:0.0:1789117482.719594:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362419712 00000100:00100000:0.0:1789117482.719677:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 148 00000100:00100000:0.0:1789117482.719686:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+32:11578:x1876025362419712:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:0.0:1789117482.719718:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117482.719736:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e6ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c9c8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.719783:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e6ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9c8 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.719792:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e6ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9c8 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117482.719806:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:0.0:1789117482.719808:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789117482.719810:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbd000, rc 0) 00000100:00100000:0.0:1789117482.719867:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+33:11578:x1876025362419712:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 182us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117482.719874:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 148 00000100:00100000:2.0:1789117482.722553:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117482.722712:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362419968 00000100:00100000:0.0:1789117482.722721:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362419968 00000100:00100000:0.0:1789117482.722778:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 39 00000100:00100000:0.0:1789117482.722788:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16814843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+33:11578:x1876025362419968:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:0.0:1789117482.723031:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16814843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+34:11578:x1876025362419968:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 244us (486us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1789117482.723039:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 39 00000100:00100000:3.0:1789117482.805591:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117482.805818:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362420224 00000100:00100000:1.0:1789117482.805827:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362420224 00000100:00100000:1.0:1789117482.805908:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 149 00000100:00100000:1.0:1789117482.805920:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+34:11588:x1876025362420224:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117482.805958:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117482.805982:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e6b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c9cf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117482.806093:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1789117482.806207:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e6b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9cf expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.806443:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9e600) 00010000:00010000:1.0:1789117482.806447:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789117482.806453:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e6b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9cf expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.806467:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442ec00, rc 0) 00000100:00100000:1.0:1789117482.806527:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+35:11588:x1876025362420224:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 610us (946us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1789117482.806534:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 149 00000100:00100000:3.0:1789117482.812229:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117482.812387:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362420352 00000100:00100000:2.0:1789117482.812396:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362420352 00000100:00100000:2.0:1789117482.812492:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 150 00000100:00100000:2.0:1789117482.812502:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+35:11588:x1876025362420352:12345-192.168.206.37@tcp:34:lfs.0 00010000:00010000:2.0:1789117482.812577:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e6c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.812594:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e6c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.812605:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e6c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.812744:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e6c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.812755:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.812763:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.812854:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.812863:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.812871:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789117482.812910:0:5839:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.812922:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e6c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.812934:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e6c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.812951:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e6c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.812957:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457ec00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117482.812961:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e6c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.812967:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e6c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.812980:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:2.0:1789117482.812983:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117482.812988:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e6c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.812994:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e6c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.813006:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.813012:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.813017:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.813022:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e400 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117482.813030:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.813037:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e6c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.813045:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c1783e89a00) 00010000:00010000:2.0:1789117482.813047:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117482.813050:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e6c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.813056:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e6c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.813072:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.813078:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.813083:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.813088:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457fa00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117482.813091:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.813096:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.813104:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:2.0:1789117482.813106:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117482.813115:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.813122:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117482.813198:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+35:11588:x1876025362420352:12345-192.168.206.37@tcp:34:lfs.0 Request processed in 696us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117482.813206:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 150 00000100:00100000:3.0:1789117482.817495:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117482.820567:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362420608 00000100:00100000:2.0:1789117482.820577:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362420608 00000100:00100000:2.0:1789117482.820639:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 40 00000100:00100000:2.0:1789117482.820649:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+35:11588:x1876025362420608:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:2.0:1789117482.820925:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+36:11588:x1876025362420608:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 276us (3447us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1789117482.820933:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 40 00010000:00010000:2.0:1789117482.823226:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117482.851595:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117482.851686:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362420864 00000100:00100000:1.0:1789117482.851707:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362420864 00000100:00100000:1.0:1789117482.851779:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 151 00000100:00100000:1.0:1789117482.851789:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+36:11591:x1876025362420864:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117482.851812:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117482.851832:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e6d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c9d6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.851927:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e6dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.851950:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e6dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.851960:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e6dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.851975:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e6e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.851981:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.851987:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.852101:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e6eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.852109:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e6eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.852116:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e6eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117482.852131:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789117482.852214:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e6dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.852222:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e6dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.852227:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e6dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.852233:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e400 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117482.852237:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e6dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.852244:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e6dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.852563:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:1.0:1789117482.852567:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117482.852573:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e6dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.852580:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e6dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.852596:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.852603:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e6e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.852620:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.852625:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ea00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117482.852628:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.852635:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e6e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.852644:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c1788d9e500) 00010000:00010000:1.0:1789117482.852646:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117482.852649:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e6e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.852654:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e6e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.852696:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e6d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9d6 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.852711:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e6eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9d6 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117482.852718:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:1.0:1789117482.852720:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117482.852723:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e200, rc 0) 00000100:00100000:1.0:1789117482.852798:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+38:11591:x1876025362420864:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 1010us (1210us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1789117482.852815:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 151 00000100:00100000:3.0:1789117482.855490:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117482.855581:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362420992 00000100:00100000:2.0:1789117482.855590:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362420992 00000100:00100000:2.0:1789117482.855645:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 152 00000100:00100000:2.0:1789117482.855654:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+38:11591:x1876025362420992:12345-192.168.206.37@tcp:54:lfs.0 00010000:00010000:2.0:1789117482.855719:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.855735:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.855745:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.855801:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.855808:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.855815:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.855821:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457fa00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117482.855825:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.855832:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.855843:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:2.0:1789117482.855846:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789117482.855850:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117482.855856:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e6f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117482.855951:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+38:11591:x1876025362420992:12345-192.168.206.37@tcp:54:lfs.0 Request processed in 289us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117482.855959:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 152 00000100:00100000:0.0:1789117482.858590:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117482.858677:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362421248 00000100:00100000:3.0:1789117482.858687:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362421248 00000100:00100000:3.0:1789117482.858736:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 41 00000100:00100000:3.0:1789117482.858746:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+38:11591:x1876025362421248:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:3.0:1789117482.858999:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+39:11591:x1876025362421248:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 254us (417us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789117482.859008:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 41 00000100:00100000:2.0:1789117483.078852:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117483.078875:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b885de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385494016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117483.078964:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117483.079228:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385494016 00000100:00100000:1.0:1789117483.079236:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385494016 00000100:00100000:1.0:1789117483.079288:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789117483.079298:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385494016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117483.079330:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117483.079384:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385494016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117483.079392:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789117483.080243:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385494144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117483.080288:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117483.080353:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b885de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385494016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117483.080473:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385494144 00000100:00100000:3.0:1789117483.080479:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385494144 00000100:00100000:3.0:1789117483.080520:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789117483.080528:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876025385494144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117483.080543:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117483.080590:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876025385494144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117483.080617:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789117483.080799:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385494144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117483.092479:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117483.092589:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362421504 00000100:00100000:1.0:1789117483.092598:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362421504 00000100:00100000:1.0:1789117483.092765:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 153 00000100:00100000:1.0:1789117483.092776:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+39:11622:x1876025362421504:12345-192.168.206.37@tcp:101:cat.0 00010000:00010000:1.0:1789117483.092799:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117483.092994:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e700 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c9dd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.093088:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e707 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.093101:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.093114:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117483.093124:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789117483.093240:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e700 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9dd expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.093268:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9dd expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.093277:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:1.0:1789117483.093280:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117483.093283:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442ea00, rc 0) 00000100:00100000:1.0:1789117483.093342:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+41:11622:x1876025362421504:12345-192.168.206.37@tcp:101:cat.0 Request processed in 569us (872us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789117483.093349:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 153 00000100:00100000:0.0:1789117483.097195:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117483.097511:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362421632 00000100:00100000:2.0:1789117483.097520:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362421632 00000100:00100000:2.0:1789117483.097583:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 11 00000100:00100000:2.0:1789117483.097593:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+41:2349:x1876025362421632:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117483.097608:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117483.097633:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e707 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9dd expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.097652:0:7638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:2.0:1789117483.097656:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117483.097712:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+40:2349:x1876025362421632:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 120us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117483.097719:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 11 00000100:00100000:0.0:1789117483.102470:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117483.102558:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362421888 00000100:00100000:2.0:1789117483.102568:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362421888 00000100:00100000:2.0:1789117483.102631:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 42 00000100:00100000:2.0:1789117483.102642:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+40:11622:x1876025362421888:12345-192.168.206.37@tcp:35:cat.0 00000100:00100000:2.0:1789117483.103150:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+41:11622:x1876025362421888:12345-192.168.206.37@tcp:35:cat.0 Request processed in 508us (686us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789117483.103158:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 42 00000100:00100000:3.0:1789117483.155478:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117483.155588:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362422144 00000100:00100000:2.0:1789117483.155610:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362422144 00000100:00100000:2.0:1789117483.155667:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 154 00000100:00100000:2.0:1789117483.155678:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+41:11628:x1876025362422144:12345-192.168.206.37@tcp:101:dd.0 00010000:00010000:2.0:1789117483.155701:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117483.155704:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789117483.155729:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e66d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9b3 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.155749:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:2.0:1789117483.155754:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117483.155780:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e715 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c9e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.155869:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e71c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.155882:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e6eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9d6 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.155891:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e71c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.156058:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e6eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9d6 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.156072:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e6eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9d6 expref: 41 pid: 5841 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117483.156086:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f0d680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876025385494272:192.168.206.37@tcp:104: 00000100:00100000:2.0:1789117483.156185:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f43000 going to sleep for 11 seconds 00000100:00100000:0.0:1789117483.159844:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117483.159963:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f0d680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876025385494272:192.168.206.37@tcp:104: 00010000:00010000:2.0:1789117483.159991:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e71c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117483.160059:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362422272 00000100:00100000:1.0:1789117483.160066:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362422272 00010000:00010000:1.0:1789117483.160099:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e6eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9d6 expref: 42 pid: 5841 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117483.160135:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 69 00000100:00100000:1.0:1789117483.160145:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c90780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+42:2349:x1876025362422272:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117483.160159:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117483.160166:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e6eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9d6 expref: 42 pid: 5841 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.160177:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e6eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9d6 expref: 42 pid: 5841 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.160197:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e6eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9d6 expref: 42 pid: 5841 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.160231:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:1.0:1789117483.160236:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e71c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.160246:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e71c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.160267:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e71c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.160295:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117483.160349:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c90780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+41:2349:x1876025362422272:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 204us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117483.160357:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 69 00010000:00010000:2.0:1789117483.160565:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e71c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.160572:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e71c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117483.160589:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789117483.160727:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e715 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9e4 expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.160743:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e71c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9e4 expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.160751:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:2.0:1789117483.160754:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789117483.160756:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457e400, rc 0) 00000100:00100000:2.0:1789117483.160796:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+41:11628:x1876025362422144:12345-192.168.206.37@tcp:101:dd.0 Request processed in 5120us (5328us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789117483.160804:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 154 00000100:00100000:0.0:1789117483.164595:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117483.164667:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362422528 00000100:00100000:2.0:1789117483.164676:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362422528 00000100:00100000:2.0:1789117483.164728:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 155 00000100:00100000:2.0:1789117483.164739:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+41:11628:x1876025362422528:12345-192.168.206.37@tcp:36:dd.0 00010000:00010000:2.0:1789117483.165022:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e72a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.165037:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e72a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.165047:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e72a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789117483.165096:0:7242:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1789117483.165121:0:7242:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000545eaa0 reply state 000000007ec68615 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e72a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117483.165129:0:7242:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789117483.165215:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+44:11628:x1876025362422528:12345-192.168.206.37@tcp:36:dd.0 Request processed in 476us (627us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1789117483.165223:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 155 00000020:00080000:2.0:1789117483.165228:0:7242:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789117483.167376:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e72a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.167391:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e72a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.167429:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e72a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.167436:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457ec00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117483.167442:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e72a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.167449:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e72a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.167477:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:2.0:1789117483.167481:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117483.167485:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e72a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.167492:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e72a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117483.436546:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117483.436730:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362422656 00000100:00100000:2.0:1789117483.436741:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362422656 00000100:00100000:2.0:1789117483.436797:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 156 00000100:00100000:2.0:1789117483.436807:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c087bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+43:11642:x1876025362422656:12345-192.168.206.37@tcp:101:stat.0 00010000:00010000:2.0:1789117483.436829:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117483.436848:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e731 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c9eb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.436926:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e738 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.436950:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e738 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.436962:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e738 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.436977:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e73f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.436983:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.437000:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.437098:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e746 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.437109:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e71c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9e4 expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.437117:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e746 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.437152:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e71c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9e4 expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.437165:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e71c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9e4 expref: 44 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117483.437180:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f0d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876025385494400:192.168.206.37@tcp:104: 00000100:00100000:2.0:1789117483.437289:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f43840 going to sleep for 11 seconds 00000100:00100000:2.0:1789117483.446533:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f0d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876025385494400:192.168.206.37@tcp:104: 00010000:00010000:2.0:1789117483.446563:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e746 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117483.448068:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117483.448215:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362422912 00000100:00100000:1.0:1789117483.448224:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362422912 00000100:00100000:1.0:1789117483.448426:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 43 00000100:00100000:1.0:1789117483.448436:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c08783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+45:5602:x1876025362422912:12345-192.168.206.37@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789117483.448793:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c08783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+46:5602:x1876025362422912:12345-192.168.206.37@tcp:35:ldlm_bl.0 Request processed in 357us (731us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1789117483.448801:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 43 00000100:00100000:3.0:1789117483.453759:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117483.454504:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362423040 00000100:00100000:0.0:1789117483.454515:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362423040 00010000:00010000:0.0:1789117483.454558:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e71c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9e4 expref: 46 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117483.454606:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 70 00000100:00100000:0.0:1789117483.454624:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+46:2350:x1876025362423040:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117483.454640:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117483.454648:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e71c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9e4 expref: 46 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.454663:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e71c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9e4 expref: 46 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.454685:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460e71c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9e4 expref: 46 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.454703:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:0.0:1789117483.454708:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e746 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.454718:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.454743:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e746 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.454796:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117483.454848:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+45:2350:x1876025362423040:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 233us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117483.454856:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 70 00010000:00010000:2.0:1789117483.454951:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.454960:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117483.455007:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789117483.455012:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789117483.455030:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.455043:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.455053:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e738 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.455058:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e738 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.455064:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e738 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.455070:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457fa00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117483.455074:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e738 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.455080:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e738 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.455096:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:2.0:1789117483.455098:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117483.455102:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e738 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.455107:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e738 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.455198:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.455209:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e73f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.455215:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e73f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.455221:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117483.455225:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e73f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.455288:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e73f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.455297:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c1783e89a00) 00010000:00010000:2.0:1789117483.455299:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117483.455302:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e73f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.455307:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e73f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.455350:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e731 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9eb expref: 45 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.455369:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e746 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9eb expref: 44 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.455393:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:2.0:1789117483.455396:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117483.455426:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f800, rc 0) 00000100:00100000:2.0:1789117483.455458:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c087bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+44:11642:x1876025362422656:12345-192.168.206.37@tcp:101:stat.0 Request processed in 18651us (18921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117483.455466:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 156 00000100:00100000:3.0:1789117483.518858:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117483.518969:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362423296 00000100:00100000:2.0:1789117483.518979:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362423296 00000100:00100000:2.0:1789117483.519045:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 157 00000100:00100000:2.0:1789117483.519056:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+44:11648:x1876025362423296:12345-192.168.206.37@tcp:36:truncate.0 00010000:00010000:2.0:1789117483.519107:0:7242:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117483.519132:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e746 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9eb expref: 44 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.519149:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:2.0:1789117483.519154:0:7242:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117483.519351:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e74d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.519364:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e74d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.519373:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e74d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789117483.519760:0:7242:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1789117483.519791:0:7242:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a1e54401 reply state 00000000ae72573f transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e74d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117483.519812:0:7242:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789117483.519908:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+46:11648:x1876025362423296:12345-192.168.206.37@tcp:36:truncate.0 Request processed in 853us (1059us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789117483.519916:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 157 00000020:00080000:2.0:1789117483.519921:0:7242:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789117483.525217:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e74d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117483.525235:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e74d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117483.525241:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e74d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117483.525248:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457ec00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117483.525317:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e74d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117483.525327:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e74d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117483.525342:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:3.0:1789117483.525345:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117483.525350:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e74d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117483.525356:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e74d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117483.648995:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117483.649736:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362423424 00000100:00100000:0.0:1789117483.649746:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362423424 00000100:00100000:0.0:1789117483.650354:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 158 00000100:00100000:0.0:1789117483.650366:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+45:11662:x1876025362423424:12345-192.168.206.37@tcp:101:stat.0 00010000:00010000:0.0:1789117483.650388:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117483.651042:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e754 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c9f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651110:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e75b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651124:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e75b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651135:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e75b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651149:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e762 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651157:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651181:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651275:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e769 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651284:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651291:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117483.651325:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789117483.651330:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789117483.651351:0:5839:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651363:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651371:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e75b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651377:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e75b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651384:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e75b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651390:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbcc00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117483.651395:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e75b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651429:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e75b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651442:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:0.0:1789117483.651446:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117483.651450:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e75b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651456:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e75b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651469:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651475:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e762 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651481:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651487:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbca00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117483.651489:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651495:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e762 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651502:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c1782c0e100) 00010000:00010000:0.0:1789117483.651504:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117483.651506:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e762 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651522:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e762 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651558:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e754 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9f2 expref: 47 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651570:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e769 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9f2 expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.651578:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:0.0:1789117483.651581:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117483.651584:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbd600, rc 0) 00000100:00100000:0.0:1789117483.653048:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+46:11662:x1876025362423424:12345-192.168.206.37@tcp:101:stat.0 Request processed in 2676us (4053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117483.653059:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 158 00000100:00100000:1.0:1789117483.738890:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117483.739124:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362423680 00000100:00100000:2.0:1789117483.739133:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362423680 00000100:00100000:2.0:1789117483.739195:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 159 00000100:00100000:2.0:1789117483.739206:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+46:11672:x1876025362423680:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:2.0:1789117483.739243:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117483.739266:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e770 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9c9f9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117483.739713:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1789117483.739987:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e770 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9f9 expref: 48 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.740002:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9e600) 00010000:00010000:2.0:1789117483.740005:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789117483.740010:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e770 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9f9 expref: 48 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.740022:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f800, rc 0) 00000100:00100000:2.0:1789117483.740087:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+47:11672:x1876025362423680:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 884us (1207us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1789117483.740095:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 159 00000100:00100000:3.0:1789117483.745691:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117483.745877:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362423936 00000100:00100000:2.0:1789117483.745886:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362423936 00000100:00100000:2.0:1789117483.745953:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 44 00000100:00100000:2.0:1789117483.745964:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a9732450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+47:11672:x1876025362423936:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:2.0:1789117483.746224:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a9732450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+48:11672:x1876025362423936:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 261us (541us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789117483.746233:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 44 00000100:00100000:3.0:1789117483.814857:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117483.817247:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362424192 00000100:00100000:2.0:1789117483.817262:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362424192 00000100:00100000:2.0:1789117483.817329:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 160 00000100:00100000:2.0:1789117483.817340:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+48:11678:x1876025362424192:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:2.0:1789117483.817364:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117483.817383:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e77e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca00 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.817511:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e785 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.817526:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e769 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9f2 expref: 49 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.817535:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e785 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.817580:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e769 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9f2 expref: 49 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.817593:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e769 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9f2 expref: 49 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117483.817629:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f0d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876025385494528:192.168.206.37@tcp:104: 00000100:00100000:2.0:1789117483.817733:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f43840 going to sleep for 11 seconds 00000100:00100000:2.0:1789117483.819322:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f0d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876025385494528:192.168.206.37@tcp:104: 00010000:00010000:2.0:1789117483.819345:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e785 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117483.819871:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117483.819959:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362424320 00000100:00100000:1.0:1789117483.819966:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362424320 00010000:00010000:1.0:1789117483.820002:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e769 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9f2 expref: 50 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117483.820057:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 71 00000100:00100000:1.0:1789117483.820066:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17845e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+50:2349:x1876025362424320:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117483.820080:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117483.820086:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e769 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9f2 expref: 50 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.820098:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e769 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9f2 expref: 50 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.820120:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e769 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9f2 expref: 50 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.820136:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:1.0:1789117483.820141:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e785 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.820150:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e785 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.820158:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e785 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.820187:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117483.820235:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17845e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+49:2349:x1876025362424320:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 169us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117483.820242:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 71 00010000:00010000:2.0:1789117483.821076:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e785 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.821087:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e785 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117483.821108:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1789117483.821269:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e77e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca00 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.821287:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e785 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca00 expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.821295:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:2.0:1789117483.821299:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789117483.821302:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f200, rc 0) 00000100:00100000:2.0:1789117483.821359:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+49:11678:x1876025362424192:12345-192.168.206.37@tcp:101:bash.0 Request processed in 4020us (6510us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1789117483.821366:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 160 00000100:00100000:3.0:1789117483.826808:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117483.828532:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362424576 00000100:00100000:1.0:1789117483.828574:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362424576 00000100:00100000:1.0:1789117483.828649:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 161 00000100:00100000:1.0:1789117483.828660:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+49:11678:x1876025362424576:12345-192.168.206.37@tcp:36:bash.0 00010000:00010000:1.0:1789117483.828916:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e793 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.828932:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.828956:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789117483.829009:0:7242:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1789117483.829032:0:7242:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004a06d5f1 reply state 00000000a2b3ba0a transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117483.829041:0:7242:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789117483.829138:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+52:11678:x1876025362424576:12345-192.168.206.37@tcp:36:bash.0 Request processed in 479us (2338us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1789117483.829145:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 161 00000020:00080000:1.0:1789117483.829149:0:7242:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789117483.831277:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.831292:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e793 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.831299:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e793 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.831305:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117483.831309:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e793 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.831333:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e793 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.831348:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:1.0:1789117483.831350:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117483.831355:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e793 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.831360:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e793 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117483.836537:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117483.838523:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362424704 00000100:00100000:0.0:1789117483.838534:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362424704 00000100:00100000:0.0:1789117483.838606:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 162 00000100:00100000:0.0:1789117483.838616:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+51:11678:x1876025362424704:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:0.0:1789117483.838640:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117483.838661:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e79a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca07 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.838744:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e7a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.838980:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e785 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca00 expref: 52 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.839001:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e7a1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.839031:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e785 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca00 expref: 52 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.839043:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e785 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca00 expref: 52 pid: 5840 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117483.839056:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0878b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876025385494656:192.168.206.37@tcp:104: 00000100:00100000:0.0:1789117483.839138:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1784faae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789117483.841238:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0878b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876025385494656:192.168.206.37@tcp:104: 00010000:00010000:2.0:1789117483.841282:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e7a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117483.842082:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117483.842188:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362424832 00000100:00100000:0.0:1789117483.842196:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362424832 00010000:00010000:0.0:1789117483.842230:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e785 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca00 expref: 53 pid: 5840 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117483.842314:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 72 00000100:00100000:0.0:1789117483.842324:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+53:2350:x1876025362424832:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117483.842337:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117483.842343:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e785 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca00 expref: 53 pid: 5840 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.842354:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e785 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca00 expref: 53 pid: 5840 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.842374:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460e785 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca00 expref: 53 pid: 5840 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.842629:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:0.0:1789117483.842636:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e7a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.842645:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.842652:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e7a1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117483.842681:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117483.842734:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+52:2350:x1876025362424832:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 412us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117483.842747:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 72 00010000:00010000:2.0:1789117483.843050:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.843060:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117483.844035:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789117483.844041:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789117483.844062:0:5839:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.844095:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e79a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca07 expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.844113:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e7a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca07 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.844120:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:2.0:1789117483.844123:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117483.844126:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbd800, rc 0) 00000100:00100000:2.0:1789117483.844221:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+51:11678:x1876025362424704:12345-192.168.206.37@tcp:101:bash.0 Request processed in 5606us (7694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117483.844229:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 162 00010000:00010000:2.0:1789117483.845728:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117483.846993:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117483.847033:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362425088 00000100:00100000:2.0:1789117483.847042:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362425088 00000100:00100000:2.0:1789117483.847123:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 45 00000100:00100000:2.0:1789117483.847141:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+51:11678:x1876025362425088:12345-192.168.206.37@tcp:35:bash.0 00000100:00100000:2.0:1789117483.847340:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+52:11678:x1876025362425088:12345-192.168.206.37@tcp:35:bash.0 Request processed in 198us (350us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1789117483.847347:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 45 00000100:00100000:0.0:1789117483.929969:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117483.930063:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362425344 00000100:00100000:1.0:1789117483.930072:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362425344 00000100:00100000:1.0:1789117483.930132:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 163 00000100:00100000:1.0:1789117483.930140:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0878f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+52:11688:x1876025362425344:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117483.930160:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117483.930176:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e7a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca0e expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117483.930281:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1789117483.930376:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e7a8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca0e expref: 54 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.930388:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9e600) 00010000:00010000:1.0:1789117483.930391:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789117483.930395:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e7a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca0e expref: 54 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117483.930682:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442ec00, rc 0) 00000100:00100000:1.0:1789117483.930738:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0878f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+53:11688:x1876025362425344:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 598us (777us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1789117483.930745:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 163 00000100:00100000:3.0:1789117483.944973:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117483.945081:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362425472 00000100:00100000:2.0:1789117483.945091:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362425472 00000100:00100000:2.0:1789117483.945218:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 164 00000100:00100000:2.0:1789117483.945228:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+53:11688:x1876025362425472:12345-192.168.206.37@tcp:34:lfs.0 00010000:00010000:2.0:1789117483.945301:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e7b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945330:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e7b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945344:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e7b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945360:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e7bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945379:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e7bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945387:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e7bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945544:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e7c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945553:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945575:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789117483.945616:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945629:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e7b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945636:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e7b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945643:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e7b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945649:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117483.945653:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e7b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945661:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e7b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945672:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:2.0:1789117483.945675:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117483.945680:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e7b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945687:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e7b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945699:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e7bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945715:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e7bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945721:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e7bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945726:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457fa00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117483.945729:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e7bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945735:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e7bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945744:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c1783e89a00) 00010000:00010000:2.0:1789117483.945746:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117483.945749:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e7bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945755:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e7bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945770:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945776:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e7c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945781:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e7c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945786:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117483.945810:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e7c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945817:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e7c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945826:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:2.0:1789117483.945828:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117483.945831:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e7c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117483.945837:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e7c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117483.945904:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+53:11688:x1876025362425472:12345-192.168.206.37@tcp:34:lfs.0 Request processed in 677us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117483.945913:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 164 00000100:00100000:3.0:1789117483.948023:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117483.950883:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362425728 00000100:00100000:1.0:1789117483.950896:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362425728 00000100:00100000:1.0:1789117483.950973:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 46 00000100:00100000:1.0:1789117483.950984:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+53:11688:x1876025362425728:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:1.0:1789117483.951213:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+54:11688:x1876025362425728:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 231us (3196us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1789117483.951221:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 46 00000100:00100000:1.0:1789117484.000053:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117484.000597:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362425984 00000100:00100000:2.0:1789117484.000606:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362425984 00000100:00100000:2.0:1789117484.000681:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 165 00000100:00100000:2.0:1789117484.000692:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+54:11691:x1876025362425984:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:2.0:1789117484.000716:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117484.000736:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e7cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca15 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789117484.000740:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789117484.000818:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e7d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.000832:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e7d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.000872:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e7d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001059:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e7d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001069:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001076:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001201:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e7e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001211:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001218:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117484.001227:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789117484.001473:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e7d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001481:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e7d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001488:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e7d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001494:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457fa00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117484.001506:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e7d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001515:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e7d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001527:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:2.0:1789117484.001530:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117484.001535:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e7d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001541:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460e7d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001554:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001561:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e7d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001567:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e7d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001572:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117484.001575:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e7d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001581:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e7d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001588:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c1783e89a00) 00010000:00010000:2.0:1789117484.001590:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117484.001610:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e7d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001616:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460e7d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001660:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e7cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca15 expref: 57 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001675:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca15 expref: 56 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.001683:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:2.0:1789117484.001685:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117484.001688:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f600, rc 0) 00000100:00100000:2.0:1789117484.001751:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+56:11691:x1876025362425984:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 1061us (1706us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1789117484.001759:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 165 00000100:00100000:2.0:1789117484.011910:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117484.011958:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117484.012012:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362426240 00000100:00100000:1.0:1789117484.012012:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362426112 00000100:00100000:3.0:1789117484.012021:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362426240 00000100:00100000:1.0:1789117484.012021:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362426112 00000100:00100000:3.0:1789117484.012081:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 12 00000100:00100000:1.0:1789117484.012082:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 166 00000100:00100000:1.0:1789117484.012096:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+57:11691:x1876025362426112:12345-192.168.206.37@tcp:54:lfs.0 00000100:00100000:3.0:1789117484.012099:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+57:2349:x1876025362426240:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117484.012116:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117484.012140:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e7e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca15 expref: 57 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117484.012155:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:1.0:1789117484.012158:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e7ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117484.012159:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789117484.012187:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e7ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.012199:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e7ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117484.012208:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+56:2349:x1876025362426240:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 114us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117484.012216:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 12 00010000:00010000:1.0:1789117484.012228:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e7ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.012260:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e7ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.012268:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e7ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.012275:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e400 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117484.012283:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e7ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.012292:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e7ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.012303:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:1.0:1789117484.012307:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789117484.012311:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e7ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.012317:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e7ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117484.012380:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+55:11691:x1876025362426112:12345-192.168.206.37@tcp:54:lfs.0 Request processed in 286us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117484.012387:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 166 00000100:00100000:2.0:1789117484.019511:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117484.019783:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362426496 00000100:00100000:3.0:1789117484.019793:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362426496 00000100:00100000:3.0:1789117484.019856:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 47 00000100:00100000:3.0:1789117484.019866:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681486580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+55:11691:x1876025362426496:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:3.0:1789117484.020106:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681486580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+56:11691:x1876025362426496:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 239us (602us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1789117484.020128:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 47 00000001:00080000:3.0:1789117484.183919:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1789117484.183952:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1789117484.184907:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967432 is committed 00000001:00080000:0.0:1789117484.184918:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967452 is committed 00000001:00080000:0.0:1789117484.184949:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000020:00080000:0.0:1789117484.184976:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c17c1d96240 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789117484.184981:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c17c0204b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c17c1d96e40 00000020:00080000:0.0:1789117484.184984:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c17c0204400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c1681533800 00000001:00080000:0.0:1789117484.185027:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000004:00080000:0.0:1789117484.185035:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:0.0:1789117484.185162:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c087a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385494784:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789117484.185230:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117484.185338:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385494784 00000100:00100000:0.0:1789117484.185345:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385494784 00000100:00100000:0.0:1789117484.185395:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789117484.185424:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c087ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385494784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789117484.185448:0:8269:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1789117484.185477:0:8269:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3c429, atime: 0x6aa3c429, ctime: 0x6aa3c429, blocks: 0xb 00010000:00010000:0.0:1789117484.185485:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b7c8020/0xf7565228e460e7f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117484.185499:0:8269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=331s v=(0 0) 00010000:00010000:0.0:1789117484.185503:0:8269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117484.185509:0:8269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b7c8020/0xf7565228e460e7f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117484.185525:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b7c8020/0xf7565228e460e7f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117484.185535:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b7c8020/0xf7565228e460e7f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117484.185542:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b7c8020/0xf7565228e460e7f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117484.185559:0:8269:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:1.0:1789117484.186462:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1789117484.186596:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789117484.186865:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c087ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1876025385494784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1440us (1632us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789117484.186875:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1789117484.186999:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789117484.187013:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117484.187019:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b7c8020/0xf7565228e460e7f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117484.187030:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbc400 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:0.0:1789117484.187035:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b7c8020/0xf7565228e460e7f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117484.187044:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b7c8020/0xf7565228e460e7f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117484.187061:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b7c8020/0xf7565228e460e7f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117484.187068:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b7c8020/0xf7565228e460e7f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117484.187085:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117484.187086:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117484.187088:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117484.187201:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1789117484.187207:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1789117484.187228:0:3300:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9c17c087a940 x1876025385494784/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789117500 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789117484.187385:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c17c087a940/2, rc 0, transno 4294967307 00000100:00100000:1.0:1789117484.187392:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c087a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385494784:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789117484.205479:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117484.205617:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362426752 00000100:00100000:1.0:1789117484.205627:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362426752 00000100:00100000:1.0:1789117484.205686:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 167 00000100:00100000:1.0:1789117484.205696:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+16:11709:x1876025362426752:12345-192.168.206.37@tcp:101:cat.0 00010000:00010000:1.0:1789117484.205718:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117484.205738:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e7fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca1c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.205843:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e803 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.205857:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e803 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.205868:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e803 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117484.205879:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789117484.206129:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e7fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca1c expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.206147:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e803 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca1c expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.206156:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:1.0:1789117484.206159:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789117484.206177:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442fe00, rc 0) 00000100:00100000:1.0:1789117484.206239:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+18:11709:x1876025362426752:12345-192.168.206.37@tcp:101:cat.0 Request processed in 544us (769us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1789117484.206247:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 167 00000100:00100000:2.0:1789117484.229833:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117484.229981:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362426880 00000100:00100000:0.0:1789117484.229992:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362426880 00000100:00100000:0.0:1789117484.230522:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 168 00000100:00100000:0.0:1789117484.230534:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16814843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+18:11710:x1876025362426880:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:0.0:1789117484.230560:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117484.230580:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e811 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca23 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117484.230664:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e818 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117484.230679:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117484.230690:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117484.230886:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1789117484.230891:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789117484.230991:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117484.231023:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e811 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca23 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117484.231041:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e818 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca23 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117484.231050:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:0.0:1789117484.231053:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789117484.231057:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbcc00, rc 0) 00000100:00100000:0.0:1789117484.231128:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16814843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+19:11710:x1876025362426880:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 596us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117484.231135:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 168 00000100:00100000:2.0:1789117484.235549:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117484.235678:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362427264 00000100:00100000:0.0:1789117484.235688:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362427264 00000100:00100000:0.0:1789117484.235771:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 48 00000100:00100000:0.0:1789117484.235782:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16814861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+19:11710:x1876025362427264:12345-192.168.206.37@tcp:35:lfs.0 00000001:00080000:0.0:1789117484.236073:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967456 00000100:00100000:0.0:1789117484.236190:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16814861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+21:11710:x1876025362427264:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 410us (650us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1789117484.236198:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 48 00000020:00080000:0.0:1789117484.236203:0:5843:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789117484.237900:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117484.238041:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362427392 00000100:00100000:2.0:1789117484.238049:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362427392 00000100:00100000:2.0:1789117484.238112:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 13 00000100:00100000:2.0:1789117484.238122:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+21:11710:x1876025362427392:12345-192.168.206.37@tcp:103:lfs.0 00010000:00010000:2.0:1789117484.238137:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789117484.238171:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e7a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca07 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.238192:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e803 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca1c expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.238204:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e6ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c9c8 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117484.238213:0:7638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0ed00) 00010000:00010000:2.0:1789117484.238225:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117484.238286:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+18:11710:x1876025362427392:12345-192.168.206.37@tcp:103:lfs.0 Request processed in 166us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117484.238294:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 13 00000100:00100000:2.0:1789117484.240480:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117484.240593:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362427520 00000100:00100000:1.0:1789117484.240602:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362427520 00000100:00100000:1.0:1789117484.240652:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 169 00000100:00100000:1.0:1789117484.240662:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+18:11710:x1876025362427520:12345-192.168.206.37@tcp:58:lfs.0 00010000:00010000:1.0:1789117484.240798:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e81f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.240813:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e81f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.240824:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e81f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789117484.241145:0:7242:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1789117484.241228:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+18:11710:x1876025362427520:12345-192.168.206.37@tcp:58:lfs.0 Request processed in 566us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117484.241236:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 169 00000100:00100000:3.0:1789117484.266268:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117484.266454:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362427648 00000100:00100000:1.0:1789117484.266464:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362427648 00000100:00100000:1.0:1789117484.266514:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 170 00000100:00100000:1.0:1789117484.266524:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+18:11712:x1876025362427648:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117484.266546:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117484.266571:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fc00/0xf7565228e460e826 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca2a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.266658:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e82d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.266671:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e82d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.266682:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e82d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.266694:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e834 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.266700:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.266706:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267112:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e83b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267122:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e83b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267130:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e83b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117484.267164:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789117484.267169:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789117484.267186:0:5839:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e83b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267210:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e83b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267218:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e82d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267225:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e82d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267231:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e82d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267236:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442fa00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117484.267240:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e82d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267260:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e82d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267272:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:1.0:1789117484.267275:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117484.267280:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e82d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267286:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e82d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267299:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267306:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e834 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267318:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e834 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267323:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ee00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117484.267325:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e834 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267331:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e834 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267339:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c1788d9e500) 00010000:00010000:1.0:1789117484.267342:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117484.267345:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e834 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267351:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e834 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267383:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fc00/0xf7565228e460e826 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca2a expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267397:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e83b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca2a expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117484.267464:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e900) 00010000:00010000:1.0:1789117484.267466:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789117484.267468:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442fe00, rc 0) 00000100:00100000:1.0:1789117484.267522:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+19:11712:x1876025362427648:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 999us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117484.267539:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 170 00010000:00010000:2.0:1789117484.869634:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789117484.954872:0:12856:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789117484.954881:0:12856:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789117484.954926:0:12856:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1789117484.954946:0:12856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789117485.189652:0:12082:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789117485.189660:0:12082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789117485.189692:0:12082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1789117485.189698:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789117485.189811:0:12082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c16822b5680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12082:1876025385494912:192.168.206.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789117485.189982:0:12082:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681f1da80 going to sleep for 11 seconds 00000100:00100000:3.0:1789117485.197311:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117485.197522:0:12082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c16822b5680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12082:1876025385494912:192.168.206.37@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789117485.198829:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362427776 00000100:00100000:1.0:1789117485.198838:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362427776 00000100:00100000:1.0:1789117485.198917:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 171 00000100:00100000:1.0:1789117485.198937:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+19:11725:x1876025362427776:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789117485.198970:0:7242:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789117485.199078:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+19:11725:x1876025362427776:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 Request processed in 152us (1776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117485.199094:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 171 00000100:00100000:3.0:1789117485.205150:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117485.205649:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362427904 00000100:00100000:1.0:1789117485.205658:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362427904 00000100:00100000:1.0:1789117485.205706:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 172 00000100:00100000:1.0:1789117485.205715:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168149ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+19:11725:x1876025362427904:12345-192.168.206.37@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789117485.206494:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e842 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206512:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e842 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206526:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e842 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206541:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e849 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206548:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e849 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206572:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e849 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206601:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e850 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206609:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206616:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117485.206652:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789117485.206657:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789117485.206670:0:5839:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206683:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e842 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206689:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e842 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206696:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e842 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206703:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117485.206707:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e842 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206715:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e842 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206735:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1788d9e000) 00010000:00010000:1.0:1789117485.206737:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117485.206742:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e842 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206748:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e842 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206765:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e849 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206772:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e849 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206778:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e849 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206784:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117485.206787:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e849 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206793:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e849 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206800:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9c1788d9e500) 00010000:00010000:1.0:1789117485.206802:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117485.206805:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e849 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206811:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e849 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206837:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206855:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e850 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206861:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206866:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ea00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117485.206869:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206875:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e850 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206882:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e900) 00010000:00010000:1.0:1789117485.206885:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117485.206888:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e850 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.206893:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e850 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117485.206984:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168149ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+19:11725:x1876025362427904:12345-192.168.206.37@tcp:34:lhsmtool_posix.0 Request processed in 1268us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117485.206994:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 172 00000100:00100000:3.0:1789117485.213636:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117485.214736:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362428160 00000100:00100000:1.0:1789117485.214747:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362428160 00000100:00100000:1.0:1789117485.214805:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 173 00000100:00100000:1.0:1789117485.214830:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c168149b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+19:11725:x1876025362428160:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789117485.214915:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117485.214948:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e857 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca31 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.215038:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e85e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.215053:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e85e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.215064:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e85e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117485.215075:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789117485.215379:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e85e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.215388:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e85e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.215394:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e85e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.215434:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442fa00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117485.215438:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e85e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.215446:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e85e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.215458:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e900) 00010000:00010000:1.0:1789117485.215469:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789117485.215475:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e85e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.215481:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e85e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.215523:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e857 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca31 expref: 21 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.215534:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1788d9e000) 00010000:00010000:1.0:1789117485.215536:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789117485.215540:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e857 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca31 expref: 21 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.215551:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442ec00, rc 0) 00000100:00100000:1.0:1789117485.215620:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c168149b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+20:11725:x1876025362428160:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 792us (1992us total) trans 4294967458 rc 301/301 00000100:00100000:1.0:1789117485.215627:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 173 00000100:00100000:3.0:1789117485.228098:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117485.228211:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362428288 00000100:00100000:0.0:1789117485.228220:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362428288 00000100:00100000:0.0:1789117485.228453:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 174 00000100:00100000:0.0:1789117485.228464:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788840f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+20:11725:x1876025362428288:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789117485.228499:0:5840:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789117485.228639:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788840f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+20:11725:x1876025362428288:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 Request processed in 175us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117485.228647:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 174 00000100:00100000:3.0:1789117485.235327:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117485.236138:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362428544 00000100:00100000:1.0:1789117485.236149:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362428544 00000100:00100000:1.0:1789117485.236198:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 175 00000100:00100000:1.0:1789117485.236208:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1788842580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+20:11725:x1876025362428544:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789117485.236228:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117485.236231:0:7242:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789117485.236267:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e818 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca23 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.236285:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:1.0:1789117485.236303:0:7242:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789117485.236317:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e86c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca38 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789117485.238381:0:7242:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1789117485.239198:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e873 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.239214:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.239225:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.239364:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e86c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca38 expref: 22 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.239383:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e873 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca38 expref: 21 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.239392:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c1788d9e500) 00010000:00010000:1.0:1789117485.239396:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117485.239436:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442ec00, rc 0) 00000100:00100000:1.0:1789117485.239507:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1788842580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+21:11725:x1876025362428544:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 3299us (4189us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1789117485.239964:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 175 00000100:00100000:3.0:1789117485.243685:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117485.243842:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362428800 00000100:00100000:1.0:1789117485.243851:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362428800 00000100:00100000:1.0:1789117485.244035:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 176 00000100:00100000:1.0:1789117485.244045:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+21:11725:x1876025362428800:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789117485.244110:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117485.244136:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e873 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca38 expref: 21 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.244155:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c1788d9e500) 00010000:00010000:1.0:1789117485.244165:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789117485.244186:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e881 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.244199:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e881 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.244209:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e881 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.244222:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e888 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa44a31e1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.244230:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e888 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa44a31e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.244237:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e888 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa44a31e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.245212:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e881 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.245223:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e881 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.245229:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e881 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.245301:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442fa00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117485.245306:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e881 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.245314:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e881 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.245324:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:1.0:1789117485.245326:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117485.245331:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e881 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.245336:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e881 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.245349:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e888 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa44a31e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.245355:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e888 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa44a31e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.245360:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e888 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa44a31e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.245365:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117485.245368:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e888 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa44a31e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.245374:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e888 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa44a31e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.245393:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa44a31e1 (ffff9c1788d9ee00) 00010000:00010000:1.0:1789117485.245396:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117485.245755:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e888 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa44a31e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.245824:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e888 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa44a31e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117485.245942:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+20:11725:x1876025362428800:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 Request processed in 1897us (2263us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789117485.245950:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 176 00000100:00100000:3.0:1789117485.248826:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117485.248937:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362428928 00000100:00100000:2.0:1789117485.248946:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362428928 00000100:00100000:2.0:1789117485.249002:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 177 00000100:00100000:2.0:1789117485.249012:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+20:11725:x1876025362428928:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117485.249045:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117485.249066:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e88f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca3f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.249099:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e896 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.249110:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.249120:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.249209:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e88f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca3f expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.249226:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e896 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca3f expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.249234:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c1783e89e00) 00010000:00010000:2.0:1789117485.249237:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789117485.249240:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f600, rc 0) 00000100:00100000:2.0:1789117485.249892:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+21:11725:x1876025362428928:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 870us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117485.249900:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 177 00000100:00100000:3.0:1789117485.258231:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117485.258472:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362429184 00000100:00100000:2.0:1789117485.258481:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362429184 00000100:00100000:2.0:1789117485.258538:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 178 00000100:00100000:2.0:1789117485.258549:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+21:11725:x1876025362429184:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789117485.258661:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e89d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.258678:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e89d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.258690:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e89d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789117485.258972:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1789117485.258982:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332388581638ns, next at 333388579378ns, rc = 0 00000004:00010000:2.0:1789117485.259063:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c6d57525 reply state 00000000f769ae9f transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e89d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117485.259073:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789117485.263311:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117485.263425:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362429312 00000100:00100000:1.0:1789117485.263434:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362429312 00000100:00100000:1.0:1789117485.263491:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 179 00000100:00100000:1.0:1789117485.263502:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0878780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+24:11725:x1876025362429312:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789117485.263523:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117485.263542:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e8a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca46 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.263617:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e8a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca46 expref: 25 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.263633:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e8a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca46 expref: 25 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.263652:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c1783e89e00) 00010000:00010000:1.0:1789117485.263655:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789117485.263671:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e800, rc 0) 00000100:00100000:1.0:1789117485.263719:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0878780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+25:11725:x1876025362429312:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 218us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117485.263727:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 179 00000100:00100000:3.0:1789117485.267031:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117485.267136:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362429440 00000100:00100000:0.0:1789117485.267146:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362429440 00000100:00100000:0.0:1789117485.267213:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 51 00000100:00100000:0.0:1789117485.267224:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d53c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+6:2349:x1876025362429440:12345-192.168.206.37@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789117485.267725:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d53c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+7:2349:x1876025362429440:12345-192.168.206.37@tcp:2:lhsmtool_posix.0 Request processed in 500us (700us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789117485.267735:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 51 00000100:00080000:1.0:1789117485.268267:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789117485.269836:0:5840:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789117485.269867:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+24:11725:x1876025362429184:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 Request processed in 11314us (11638us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789117485.269877:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 178 00010000:00010000:3.0:1789117485.270054:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e89d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.270066:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e89d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.270074:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e89d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.270080:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117485.270101:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e89d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.270109:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e89d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.270125:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c1783e89e00) 00010000:00010000:3.0:1789117485.270128:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789117485.270133:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e89d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.270140:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e89d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117485.271089:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117485.271174:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362429696 00000100:00100000:1.0:1789117485.271182:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362429696 00000100:00100000:1.0:1789117485.271229:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 49 00000100:00100000:1.0:1789117485.271238:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0879a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+23:11725:x1876025362429696:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789117485.271505:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0879a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+24:11725:x1876025362429696:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 Request processed in 267us (419us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789117485.271513:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 49 00000100:00100000:0.0:1789117485.275809:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117485.276050:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362429952 00000100:00100000:1.0:1789117485.276058:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362429952 00000100:00100000:1.0:1789117485.276112:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 180 00000100:00100000:1.0:1789117485.276121:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0879e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+24:11725:x1876025362429952:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789117485.276267:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0879e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+24:11725:x1876025362429952:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 Request processed in 146us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117485.276275:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 180 00000100:00100000:2.0:1789117485.279818:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117485.279990:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362430080 00000100:00100000:3.0:1789117485.279999:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362430080 00000100:00100000:3.0:1789117485.280053:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 181 00000100:00100000:3.0:1789117485.280064:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+24:11725:x1876025362430080:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789117485.280082:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117485.280102:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e8ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca4d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.280165:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e8b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.280178:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.280189:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117485.280221:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789117485.280265:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.280292:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e8ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca4d expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.280309:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca4d expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.280317:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c1783e89e00) 00010000:00010000:3.0:1789117485.280320:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789117485.280324:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685400, rc 0) 00000100:00100000:3.0:1789117485.280388:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+25:11725:x1876025362430080:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 326us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117485.280396:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 181 00000100:00100000:2.0:1789117485.282994:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117485.283320:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362430208 00000100:00100000:1.0:1789117485.283329:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362430208 00000100:00100000:1.0:1789117485.283383:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 52 00000100:00100000:1.0:1789117485.283393:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+7:2350:x1876025362430208:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789117485.283437:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117485.283455:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c1b9583/0xf7565228e460e8b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca54 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789117485.283497:0:8269:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3c42c, blocks: 0x1 00010000:00010000:1.0:1789117485.283515:0:8269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1789117485.283520:0:8269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117485.283529:0:8269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c1b9583/0xf7565228e460e8b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca54 expref: 8 pid: 8269 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.283546:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c1b9583/0xf7565228e460e8b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca54 expref: 8 pid: 8269 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.283559:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442ec00, rc 0) 00000100:00100000:1.0:1789117485.283627:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+8:2350:x1876025362430208:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 236us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117485.283634:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 52 00000100:00100000:0.0:1789117485.286683:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117485.286791:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362430464 00000100:00100000:2.0:1789117485.286800:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362430464 00000100:00100000:2.0:1789117485.286854:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 182 00000100:00100000:2.0:1789117485.286864:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c08792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+25:11725:x1876025362430464:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789117485.286978:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c08792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+25:11725:x1876025362430464:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 Request processed in 115us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117485.286986:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 182 00000100:00100000:3.0:1789117485.290133:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117485.290309:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362430592 00000100:00100000:0.0:1789117485.290318:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362430592 00000100:00100000:0.0:1789117485.290435:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 53 00000100:00100000:0.0:1789117485.290444:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+8:11725:x1876025362430592:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117485.290462:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117485.290478:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cae41405/0xf7565228e460e8c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca5b expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117485.290508:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c1b9583/0xf7565228e460e8b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca54 expref: 9 pid: 8269 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117485.290517:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117485.290521:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117485.290526:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cae41405/0xf7565228e460e8c0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca5b expref: 9 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117485.290558:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c1b9583/0xf7565228e460e8b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca54 expref: 9 pid: 8269 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117485.290582:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c1b9583/0xf7565228e460e8b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca54 expref: 9 pid: 8269 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117485.290596:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0878000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1876025385495040:192.168.206.37@tcp:104: 00000100:00100000:0.0:1789117485.290692:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b87e2540 going to sleep for 11 seconds 00000100:00100000:0.0:1789117485.293067:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117485.293153:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362430720 00000100:00100000:2.0:1789117485.293162:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362430720 00010000:00010000:2.0:1789117485.293197:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c1b9583/0xf7565228e460e8b9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca54 expref: 10 pid: 8269 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117485.293241:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 73 00000100:00100000:2.0:1789117485.293255:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c087b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+10:2349:x1876025362430720:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117485.293271:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117485.293295:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c1b9583/0xf7565228e460e8b9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca54 expref: 10 pid: 8269 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.293307:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c1b9583/0xf7565228e460e8b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca54 expref: 10 pid: 8269 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.293331:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117485.293335:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117485.293342:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cae41405/0xf7565228e460e8c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca5b expref: 10 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.293351:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cae41405/0xf7565228e460e8c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca5b expref: 10 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.293383:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cae41405/0xf7565228e460e8c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca5b expref: 10 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117485.293394:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5826:1876025385495168:192.168.206.37@tcp:105: 00000100:00100000:2.0:1789117485.293512:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681f1da80 going to sleep for 11 seconds 00010000:00010000:3.0:1789117485.293748:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c1b9583/0xf7565228e460e8b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca54 expref: 10 pid: 8269 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117485.293765:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0878000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1876025385495040:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117485.293788:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cae41405/0xf7565228e460e8c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca5b expref: 9 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.293799:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbc200, rc 0) 00000100:00100000:3.0:1789117485.293845:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+9:11725:x1876025362430592:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 3402us (3720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117485.293854:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 53 00000100:00100000:2.0:1789117485.306315:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5826:1876025385495168:192.168.206.37@tcp:105: 00010000:00010000:2.0:1789117485.306341:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117485.306736:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c087b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+8:2349:x1876025362430720:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 13480us (13675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117485.306747:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 73 00000100:00100000:0.0:1789117485.314865:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117485.319376:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362430848 00000100:00100000:1.0:1789117485.319392:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362430848 00002000:00100000:1.0:1789117485.319536:0:6690:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9c17c087b840 x1876025362430848/t0(0) o4->e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp:36/0 lens 504/0 e 0 to 0 dl 1789117496 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117485.319548:0:6690:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c17c087b840 with x1876025362430848 ext(0->8) 00002000:00010000:1.0:1789117485.319555:0:6690:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c17c087b840 00000100:00100000:1.0:1789117485.319854:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 4 00000100:00100000:1.0:1789117485.319865:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c087b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e0c4e520-7af6-449d-969f-b46035974613+8:2349:x1876025362430848:12345-192.168.206.37@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789117485.320326:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c087b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e0c4e520-7af6-449d-969f-b46035974613+10:2349:x1876025362430848:12345-192.168.206.37@tcp:4:lhsmtool_posix.0 Request processed in 463us (5471us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789117485.320344:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 4 00002000:00100000:1.0:1789117485.320352:0:6690:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9c17c087b840 x1876025362430848/t4294967314(0) o4->e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp:36/0 lens 504/448 e 0 to 0 dl 1789117496 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117485.320361:0:6690:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c17c087b840 with x1876025362430848 ext(0->8) 00002000:00010000:1.0:1789117485.320365:0:6690:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c17c087b840 00000100:00100000:0.0:1789117485.324647:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117485.328692:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362430976 00000100:00100000:3.0:1789117485.328711:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362430976 00000100:00100000:3.0:1789117485.328785:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 183 00000100:00100000:3.0:1789117485.328795:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c087a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+25:11725:x1876025362430976:12345-192.168.206.37@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789117485.385377:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000001:00080000:3.0:1789117485.385681:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000020:00080000:3.0:1789117485.385697:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1789117485.385744:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1789117485.385753:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789117485.386045:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c087a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+19:11725:x1876025362430976:12345-192.168.206.37@tcp:44:lhsmtool_posix.0 Request processed in 57245us (61468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117485.386055:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 183 00000004:00080000:3.0:1789117485.386104:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:2.0:1789117485.386529:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c087a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385495296:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789117485.386581:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117485.386751:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385495296 00000100:00100000:3.0:1789117485.386758:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385495296 00000100:00100000:3.0:1789117485.386809:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789117485.386817:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385495296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789117485.386968:0:8269:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789117485.386972:0:8269:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789117484 00002000:00010000:3.0:1789117485.386974:0:8269:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789117485.386976:0:8269:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789117484 -> 1789117484 00002000:00010000:3.0:1789117485.386979:0:8269:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789117485.387012:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1876025385495296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 196us (430us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789117485.387018:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1789117485.387052:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c17c087a1c0/2, rc 0, transno 4294967315 00000100:00100000:3.0:1789117485.387056:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c087a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385495296:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1789117485.387260:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117485.394179:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117485.394278:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362431104 00000100:00100000:3.0:1789117485.394288:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362431104 00000100:00100000:3.0:1789117485.394502:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 55 00000100:00100000:3.0:1789117485.394513:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+10:2349:x1876025362431104:12345-192.168.206.37@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789117485.509176:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1789117485.509193:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:0.0:1789117485.509202:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1789117485.509347:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+7:2349:x1876025362431104:12345-192.168.206.37@tcp:16:lhsmtool_posix.0 Request processed in 114830us (115172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117485.509359:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 55 00000100:00100000:1.0:1789117485.514581:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117485.516177:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362431360 00000100:00100000:2.0:1789117485.516190:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362431360 00000100:00100000:2.0:1789117485.516264:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 184 00000100:00100000:2.0:1789117485.516274:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+18:11725:x1876025362431360:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789117485.516323:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117485.516347:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e8b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca4d expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.517225:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c1783e89e00) 00010000:00010000:2.0:1789117485.517231:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117485.517268:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e8c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.517282:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.517292:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789117485.517730:0:5839:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c369d2b9 reply state 000000002db49f3f transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117485.517740:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789117485.517841:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+19:11725:x1876025362431360:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 Request processed in 1565us (3267us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1789117485.517850:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 184 00010000:00010000:1.0:1789117485.523335:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.523468:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e8c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.523477:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e8c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.523484:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117485.523489:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e8c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.523499:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e8c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.523517:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c1783e89e00) 00010000:00010000:1.0:1789117485.523534:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117485.523539:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e8c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.523544:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460e8c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117485.524106:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117485.524213:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362431488 00000100:00100000:1.0:1789117485.524223:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362431488 00000100:00100000:1.0:1789117485.524274:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 56 00000100:00100000:1.0:1789117485.524283:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+7:2350:x1876025362431488:12345-192.168.206.37@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789117485.524587:0:8269:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789117485.524591:0:8269:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789117484 -> 1789117483 00002000:00010000:1.0:1789117485.524594:0:8269:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789117481 00002000:00010000:1.0:1789117485.524596:0:8269:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789117484 -> 1789117483 00002000:00010000:1.0:1789117485.524599:0:8269:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789117485.524657:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+8:2350:x1876025362431488:12345-192.168.206.37@tcp:2:lhsmtool_posix.0 Request processed in 374us (557us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789117485.524666:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 56 00000100:00100000:3.0:1789117485.531896:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117485.532016:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362431744 00000100:00100000:2.0:1789117485.532025:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362431744 00000100:00100000:2.0:1789117485.532069:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 185 00000100:00100000:2.0:1789117485.532077:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+18:11725:x1876025362431744:12345-192.168.206.37@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789117485.532134:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e8ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.532146:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca3f expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.532153:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e8ce lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.532177:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e896 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca3f expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.532186:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e896 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca3f expref: 18 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117485.532196:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876025385495424:192.168.206.37@tcp:104: 00000100:00100000:2.0:1789117485.532526:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681f1d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117485.534589:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117485.534656:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362431872 00000100:00100000:3.0:1789117485.534664:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362431872 00010000:00010000:3.0:1789117485.534738:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e896 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca3f expref: 19 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117485.534864:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876025385495424:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117485.534866:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 74 00000100:00100000:3.0:1789117485.534878:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c087b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+19:2349:x1876025362431872:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117485.534891:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e8ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.534900:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117485.534909:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e896 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca3f expref: 19 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.534923:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e896 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca3f expref: 19 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.534960:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460e896 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca3f expref: 19 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.534972:0:7638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c1783e89e00) 00010000:00010000:3.0:1789117485.534977:0:7638:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e8ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.534985:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e8ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.534992:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e8ce lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.535017:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117485.535065:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c087b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+18:2349:x1876025362431872:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 189us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117485.535082:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 74 00010000:00010000:2.0:1789117485.535468:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e8ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.535477:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e8ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.535503:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e8ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.535510:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e8ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.535516:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e8ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.535522:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117485.535526:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e8ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.535533:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e8ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.535542:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c1783e89e00) 00010000:00010000:2.0:1789117485.535545:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789117485.535549:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e8ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.535567:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460e8ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117485.535861:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+17:11725:x1876025362431744:12345-192.168.206.37@tcp:55:lhsmtool_posix.0 Request processed in 3780us (3971us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789117485.535870:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 185 00000100:00100000:0.0:1789117485.537783:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117485.538003:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362432000 00000100:00100000:3.0:1789117485.538012:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362432000 00000100:00100000:3.0:1789117485.538062:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 57 00000100:00100000:3.0:1789117485.538072:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0879680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+8:2350:x1876025362432000:12345-192.168.206.37@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789117485.538115:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460e8d5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.538134:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cae41405/0xf7565228e460e8c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca5b expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.538143:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117485.538147:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789117485.538151:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460e8d5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.538187:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cae41405/0xf7565228e460e8c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca5b expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.538201:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cae41405/0xf7565228e460e8c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca5b expref: 8 pid: 6686 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117485.538215:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1785c09e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1876025385495552:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117485.538315:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17852d1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789117485.545309:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117485.545800:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362432128 00000100:00100000:2.0:1789117485.545810:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362432128 00010000:00010000:2.0:1789117485.545859:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cae41405/0xf7565228e460e8c0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca5b expref: 9 pid: 6686 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117485.545907:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 75 00000100:00100000:2.0:1789117485.545918:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0878000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+9:2350:x1876025362432128:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117485.545944:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117485.545967:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cae41405/0xf7565228e460e8c0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca5b expref: 9 pid: 6686 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.545979:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cae41405/0xf7565228e460e8c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca5b expref: 9 pid: 6686 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.546001:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789117485.546006:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789117485.546012:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460e8d5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.546023:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460e8d5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.546046:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117485.546119:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0878000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+9:2350:x1876025362432128:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 202us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117485.546127:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 75 00010000:00010000:3.0:1789117485.551555:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cae41405/0xf7565228e460e8c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca5b expref: 8 pid: 6686 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117485.551578:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1785c09e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1876025385495552:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117485.551779:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460e8d5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.551791:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460e8d5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.551798:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460e8d5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.551831:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460e8d5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.552319:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460e8d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.552331:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460e8d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.552338:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781684c00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117485.552342:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460e8d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.552371:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460e8d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.552391:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460e8d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.552434:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460e8d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117485.552525:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0879680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+7:2350:x1876025362432000:12345-192.168.206.37@tcp:1:lhsmtool_posix.0 Request processed in 14452us (14745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117485.552535:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 57 00000100:00100000:1.0:1789117485.561892:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117485.562323:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362432384 00000100:00100000:3.0:1789117485.562335:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362432384 00000100:00100000:0.0:1789117485.564486:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 186 00000100:00100000:0.0:1789117485.564500:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+17:11725:x1876025362432384:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789117485.564573:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e8dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117485.564590:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e8dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117485.564618:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e8dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117485.564803:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e8e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117485.564814:0:7242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e8a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca46 expref: 18 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117485.564822:0:7242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e8e3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117485.569050:0:7242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e8a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca46 expref: 18 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117485.569074:0:7242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e8a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca46 expref: 18 pid: 7242 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117485.569090:0:7242:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0878b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7242:1876025385495680:192.168.206.37@tcp:104: 00000100:00100000:0.0:1789117485.569175:0:7242:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b87e26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117485.573038:0:7242:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0878b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7242:1876025385495680:192.168.206.37@tcp:104: 00010000:00010000:0.0:1789117485.573067:0:7242:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e8e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117485.583057:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117485.583650:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362432512 00000100:00100000:0.0:1789117485.583661:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362432512 00010000:00010000:0.0:1789117485.583702:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e8a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca46 expref: 19 pid: 7242 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117485.583743:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 76 00000100:00100000:0.0:1789117485.583752:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17845e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+19:2349:x1876025362432512:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117485.583767:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117485.583774:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e8a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca46 expref: 19 pid: 7242 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117485.583787:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e8a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca46 expref: 19 pid: 7242 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117485.583827:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e8a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca46 expref: 19 pid: 7242 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117485.583853:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c1783e89e00) 00010000:00010000:0.0:1789117485.583858:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e8e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117485.583868:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e8e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117485.583876:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e8e3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117485.583914:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117485.583982:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17845e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+18:2349:x1876025362432512:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 230us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117485.583990:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 76 00010000:00010000:1.0:1789117485.584174:0:7242:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e8e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117485.584183:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e8e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789117485.584359:0:7242:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1789117485.584529:0:7242:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1789117485.584577:0:7242:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1789117485.584646:0:7242:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f08000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7242:1876025385495808:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789117485.584694:0:7242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117485.584716:0:7242:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1782dfd840 going to sleep for 11 seconds 00000100:00100000:0.0:1789117485.585473:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385495808 00000100:00100000:0.0:1789117485.585482:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385495808 00000100:00100000:0.0:1789117485.585525:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789117485.585535:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7242:x1876025385495808:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789117485.585734:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7242:x1876025385495808:12345-0@lo:1000:mdt00_003.0 Request processed in 200us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117485.585743:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789117485.587467:0:7242:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1789117485.587478:0:7242:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c17c087a1c0, transno 4294967315 00000100:00100000:3.0:1789117485.587496:0:7242:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f08000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7242:1876025385495808:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789117485.588291:0:7242:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1789117485.588376:0:7242:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7242:1876025385495936:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789117485.588478:0:7242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117485.588510:0:7242:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681f1da80 going to sleep for 11 seconds 00000100:00100000:1.0:1789117485.589391:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385495936 00000100:00100000:1.0:1789117485.589438:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385495936 00000100:00100000:1.0:1789117485.589481:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789117485.589491:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7242:x1876025385495936:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789117485.590078:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7242:x1876025385495936:12345-0@lo:1000:mdt00_003.0 Request processed in 587us (1597us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789117485.590087:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789117485.594068:0:7242:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f64b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7242:1876025385495936:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789117485.596159:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e8e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.596176:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e8e3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.596184:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e8e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.596191:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbcc00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117485.596196:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e8e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.596204:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e8e3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.596220:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c1783e89e00) 00010000:00010000:2.0:1789117485.596223:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789117485.596228:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e8e3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.596234:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbcc00/0xf7565228e460e8e3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.596279:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e81f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.596302:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e81f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.596309:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e81f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.596315:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e400 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117485.596319:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e81f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.596325:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e81f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.596335:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e900) 00010000:00010000:2.0:1789117485.596337:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789117485.596341:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e81f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.596347:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e81f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.596371:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.596386:0:7242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e83b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca2a expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.596395:0:7242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8ea lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.596479:0:7242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e83b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca2a expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.596500:0:7242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e83b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca2a expref: 21 pid: 5839 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117485.596514:0:7242:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b86ab0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7242:1876025385496064:192.168.206.37@tcp:104: 00000100:00100000:1.0:1789117485.602985:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117485.605948:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362432640 00000100:00100000:3.0:1789117485.605960:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362432640 00010000:00010000:3.0:1789117485.606004:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e83b lrc: 6/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca2a expref: 22 pid: 5839 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117485.606050:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 77 00000100:00100000:3.0:1789117485.606060:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+22:2350:x1876025362432640:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117485.606088:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117485.606096:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e83b lrc: 6/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca2a expref: 22 pid: 5839 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.606108:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e83b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca2a expref: 22 pid: 5839 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.606129:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e900) 00010000:00010000:3.0:1789117485.606135:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.606144:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.606151:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8ea lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.606171:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117485.606238:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+22:2350:x1876025362432640:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 179us (3261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117485.607023:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 77 00000100:00100000:2.0:1789117485.611596:0:7242:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681f1de40 going to sleep for 11 seconds 00010000:00010000:2.0:1789117485.611655:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e83b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca2a expref: 21 pid: 5839 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117485.611678:0:7242:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b86ab0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7242:1876025385496064:192.168.206.37@tcp:104: 00010000:00010000:2.0:1789117485.611701:0:7242:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.611710:0:7242:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.611717:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.611729:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.611735:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8ea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.611741:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.611747:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457ec00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117485.611768:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.611776:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8ea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.611789:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e900) 00010000:00010000:2.0:1789117485.611792:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117485.611797:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8ea lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.611803:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8ea lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.611813:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e8dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.611819:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e8dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.611824:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e8dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.611829:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbde00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117485.611832:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e8dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.611838:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e8dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.611861:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e900) 00010000:00010000:2.0:1789117485.611863:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789117485.611873:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e8dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.611888:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbde00/0xf7565228e460e8dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117485.612150:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+20:11725:x1876025362432384:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 Request processed in 47651us (50272us total) trans 4294967467 rc 0/0 00000100:00100000:2.0:1789117485.612161:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 186 00000020:00080000:2.0:1789117485.612166:0:7242:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789117485.612237:0:12082:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789117485.612242:0:12082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789117485.612795:0:12082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789117485.612806:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789117485.621904:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117485.622002:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362432896 00000100:00100000:2.0:1789117485.622012:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362432896 00000100:00100000:2.0:1789117485.622074:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 50 00000100:00100000:2.0:1789117485.622084:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a9733850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+20:11725:x1876025362432896:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789117485.622772:0:5842:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789117485.622874:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:2.0:1789117485.622918:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.622944:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.622955:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.622962:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.622969:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.622975:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117485.623010:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789117485.623092:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a9733850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+22:11725:x1876025362432896:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 Request processed in 1008us (1195us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1789117485.623101:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 50 00000020:00080000:2.0:1789117485.623106:0:5842:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789117485.623696:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117485.623703:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.623711:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457ec00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117485.623721:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.623729:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.623741:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c1783e89e00) 00010000:00010000:3.0:1789117485.623744:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789117485.623749:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8f1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.623755:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460e8f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117485.623773:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117485.623775:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117485.623776:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117485.893835:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117486.748934:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117486.748979:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117486.749006:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117486.749021:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117486.749039:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117486.749062:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362433280 00000100:00100000:2.0:1789117486.749069:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362433280 00000100:00100000:2.0:1789117486.749106:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362433408 00000100:00100000:2.0:1789117486.749108:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362433408 00000100:00100000:2.0:1789117486.749132:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 82 00000100:00100000:2.0:1789117486.749139:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+7:2351:x1876025362433280:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117486.749205:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+7:2351:x1876025362433280:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 66us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117486.749213:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 82 00000100:00100000:2.0:1789117486.749231:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 83 00000100:00100000:2.0:1789117486.749250:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+5:2351:x1876025362433408:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117486.749273:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+5:2351:x1876025362433408:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 37us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117486.749279:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 83 00000100:00080000:2.0:1789117486.749315:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789117486.749890:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362433536 00000100:00100000:0.0:1789117486.749898:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362433536 00000100:00100000:0.0:1789117486.749949:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362433152 00000100:00100000:0.0:1789117486.749953:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362433152 00000100:00100000:0.0:1789117486.749999:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 145 00000100:00100000:0.0:1789117486.750006:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681486580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362433536:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117486.750051:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681486580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362433536:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 45us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117486.750058:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 145 00000100:00100000:0.0:1789117486.750071:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 146 00000100:00100000:0.0:1789117486.750077:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16814861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+22:2351:x1876025362433152:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117486.750102:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16814861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+22:2351:x1876025362433152:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 25us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117486.750108:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 146 00000100:00080000:2.0:1789117486.750238:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117486.750455:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362433024 00000100:00100000:3.0:1789117486.750460:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362433024 00000100:00100000:3.0:1789117486.750496:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 316 00000100:00100000:3.0:1789117486.750503:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2351:x1876025362433024:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117486.750534:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2351:x1876025362433024:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 31us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117486.750540:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 316 00010000:00010000:3.0:1789117486.918590:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789117486.948135:0:12908:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789117486.948208:0:12908:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789117486.948264:0:12908:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1789117486.948272:0:12908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789117487.106125:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117487.106493:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362433792 00000100:00100000:1.0:1789117487.106504:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362433792 00000100:00100000:1.0:1789117487.106565:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 187 00000100:00100000:1.0:1789117487.106588:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+22:11743:x1876025362433792:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117487.106611:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117487.106635:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e8f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca62 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.106933:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e8ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.106951:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e8ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.106962:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e8ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117487.106986:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1789117487.107174:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e8f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca62 expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.107194:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e8ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca62 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.107203:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:1.0:1789117487.107206:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789117487.107210:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442fa00, rc 0) 00000100:00100000:1.0:1789117487.107282:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+24:11743:x1876025362433792:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 697us (1167us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789117487.107291:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 187 00000100:00100000:2.0:1789117487.110469:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117487.110592:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362433920 00000100:00100000:0.0:1789117487.110602:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362433920 00000100:00100000:0.0:1789117487.110661:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 188 00000100:00100000:0.0:1789117487.110671:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+24:11743:x1876025362433920:12345-192.168.206.37@tcp:34:lfs.0 00010000:00010000:0.0:1789117487.111102:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e90d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.111121:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e90d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.111134:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e90d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.111163:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e914 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.111171:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.111195:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.113466:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e91b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.113484:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e91b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.113494:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e91b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789117487.113542:0:7242:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e91b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.113555:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e90d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.113561:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e90d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.113567:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e90d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.114790:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117487.114797:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e90d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.114806:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e90d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.114822:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:0.0:1789117487.114833:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117487.114839:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e90d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.114846:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e90d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.114863:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.114869:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e914 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.115228:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.115301:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117487.115305:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.115313:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e914 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.115322:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c1782c0e700) 00010000:00010000:0.0:1789117487.115325:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117487.115328:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e914 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.115335:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e914 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.115353:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e91b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.115366:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e91b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.115372:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e91b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.115378:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbc400 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117487.115381:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e91b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.115387:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e91b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.115395:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1782c0e100) 00010000:00010000:0.0:1789117487.115778:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117487.115785:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e91b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.115792:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc400/0xf7565228e460e91b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117487.126358:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+24:11743:x1876025362433920:12345-192.168.206.37@tcp:34:lfs.0 Request processed in 15677us (15887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117487.126373:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 188 00000100:00100000:0.0:1789117487.185333:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117487.185508:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362434176 00000100:00100000:1.0:1789117487.185522:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362434176 00000100:00100000:1.0:1789117487.185610:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 189 00000100:00100000:1.0:1789117487.185622:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c087a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+24:11746:x1876025362434176:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117487.185653:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117487.185687:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e922 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca69 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.185806:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e929 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.185845:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e929 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.185860:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e929 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.185880:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e930 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.185889:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.185897:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.186353:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e937 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.186363:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.186371:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117487.186382:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789117487.186566:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e929 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.186574:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e929 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.186581:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e929 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.186597:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ec00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117487.186603:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e929 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.186611:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e929 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.186628:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:1.0:1789117487.186632:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117487.186639:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e929 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.186646:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e929 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.186662:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.186669:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e930 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.186676:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e930 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.186682:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442fe00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117487.186686:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e930 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.186692:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e930 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.186712:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c1788d9e200) 00010000:00010000:1.0:1789117487.186714:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117487.186718:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e930 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.186724:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460e930 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.186776:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e922 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca69 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.186792:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca69 expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.186801:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e400) 00010000:00010000:1.0:1789117487.186804:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117487.186806:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e400, rc 0) 00000100:00100000:1.0:1789117487.186899:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c087a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+26:11746:x1876025362434176:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 1279us (1583us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1789117487.186909:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 189 00000100:00100000:3.0:1789117487.189682:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117487.189822:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362434304 00000100:00100000:0.0:1789117487.189834:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362434304 00000100:00100000:0.0:1789117487.189906:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 190 00000100:00100000:0.0:1789117487.189933:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+26:11746:x1876025362434304:12345-192.168.206.37@tcp:54:lfs.0 00010000:00010000:0.0:1789117487.190039:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e945 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.190063:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.190087:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.190125:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.190133:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e945 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.190141:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e945 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.190147:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117487.190153:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e945 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.190162:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e945 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.190176:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e400) 00010000:00010000:0.0:1789117487.190180:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789117487.190186:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e945 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.190192:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460e945 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117487.190364:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+26:11746:x1876025362434304:12345-192.168.206.37@tcp:54:lfs.0 Request processed in 447us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117487.190374:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 190 00000100:00100000:0.0:1789117487.193844:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117487.193963:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362434560 00000100:00100000:1.0:1789117487.193976:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362434560 00000100:00100000:1.0:1789117487.194046:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 51 00000100:00100000:1.0:1789117487.194058:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c087b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+26:11746:x1876025362434560:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:1.0:1789117487.196010:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c087b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+27:11746:x1876025362434560:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 1942us (2167us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1789117487.196025:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 51 00000100:00100000:3.0:1789117487.239490:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117487.239545:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362434816 00000100:00100000:3.0:1789117487.239560:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362434816 00000100:00100000:3.0:1789117487.239633:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 191 00000100:00100000:3.0:1789117487.239646:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+27:11271:x1876025362434816:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:3.0:1789117487.239679:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117487.239709:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e94c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca70 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.239869:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e953 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.239890:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e937 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca69 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.239911:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e953 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.239973:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca69 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.239990:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e937 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca69 expref: 28 pid: 5841 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117487.240009:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7f08000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876025385496192:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117487.241433:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17852d1480 going to sleep for 11 seconds 00000100:00100000:3.0:1789117487.243045:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7f08000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876025385496192:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117487.243093:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e953 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117487.245019:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117487.245215:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362434944 00000100:00100000:0.0:1789117487.245229:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362434944 00010000:00010000:0.0:1789117487.245290:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e937 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca69 expref: 29 pid: 5841 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117487.245345:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 78 00000100:00100000:0.0:1789117487.245357:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+29:2349:x1876025362434944:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117487.245375:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117487.245383:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e937 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca69 expref: 29 pid: 5841 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.245416:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca69 expref: 29 pid: 5841 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.245446:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e400/0xf7565228e460e937 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca69 expref: 29 pid: 5841 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.245468:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e400) 00010000:00010000:0.0:1789117487.245475:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e953 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.245486:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e953 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.245495:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e953 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.245531:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117487.245603:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+28:2349:x1876025362434944:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 247us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117487.245624:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 78 00010000:00010000:0.0:1789117487.245658:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e953 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.245667:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e953 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117487.245690:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789117487.245902:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e94c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca70 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.245933:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e953 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca70 expref: 28 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.245942:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e400) 00010000:00010000:0.0:1789117487.245944:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789117487.245947:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781684c00, rc 0) 00000100:00100000:0.0:1789117487.245977:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+28:11271:x1876025362434816:12345-192.168.206.37@tcp:101:bash.0 Request processed in 6336us (6502us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1789117487.245984:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 191 00000100:00100000:0.0:1789117487.249453:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117487.249493:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362435200 00000100:00100000:0.0:1789117487.249504:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362435200 00000100:00100000:0.0:1789117487.249575:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 192 00000100:00100000:0.0:1789117487.249594:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c087b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+28:11271:x1876025362435200:12345-192.168.206.37@tcp:36:bash.0 00010000:00010000:0.0:1789117487.249980:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e961 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.250018:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.250033:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789117487.250100:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:0.0:1789117487.250128:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008a520f9f reply state 000000009a1bb5ce transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117487.250139:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789117487.250199:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:0.0:1789117487.250362:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c087b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+32:11271:x1876025362435200:12345-192.168.206.37@tcp:36:bash.0 Request processed in 775us (921us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1789117487.250371:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 192 00000020:00080000:0.0:1789117487.250377:0:5840:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789117487.257168:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00010000:00010000:3.0:1789117487.258874:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.258893:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e961 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.258996:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e961 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.259004:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117487.259009:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e961 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.259018:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e961 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.259038:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e400) 00010000:00010000:3.0:1789117487.259044:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117487.259049:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e961 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.259056:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd800/0xf7565228e460e961 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117487.260257:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362435328 00000100:00100000:1.0:1789117487.260274:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362435328 00000100:00100000:1.0:1789117487.260349:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 193 00000100:00100000:1.0:1789117487.260360:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+31:11271:x1876025362435328:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:1.0:1789117487.260393:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117487.260443:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e968 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca77 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.260523:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e968 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca77 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.260539:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e968 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca77 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.260562:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e400) 00010000:00010000:1.0:1789117487.260565:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789117487.260570:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442ea00, rc 0) 00000100:00100000:1.0:1789117487.260657:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+32:11271:x1876025362435328:12345-192.168.206.37@tcp:101:bash.0 Request processed in 299us (3505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117487.260666:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 193 00000100:00100000:1.0:1789117487.265073:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117487.265705:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362435456 00000100:00100000:3.0:1789117487.265725:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362435456 00000100:00100000:3.0:1789117487.265805:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 58 00000100:00100000:3.0:1789117487.265818:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+7:11271:x1876025362435456:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:3.0:1789117487.266198:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117487.266237:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d1ea30f/0xf7565228e460e96f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca7e expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789117487.266275:0:8269:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3c42b, atime: 0x6aa3c429, ctime: 0x6aa3c42b, blocks: 0xb 00010000:00010000:3.0:1789117487.266304:0:8269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=334s v=(0 0) 00010000:00010000:3.0:1789117487.266310:0:8269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117487.266320:0:8269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d1ea30f/0xf7565228e460e96f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca7e expref: 8 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.266342:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004d1ea30f/0xf7565228e460e96f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca7e expref: 8 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.266360:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781684000, rc 0) 00000100:00100000:3.0:1789117487.266557:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+8:11271:x1876025362435456:12345-192.168.206.37@tcp:101:bash.0 Request processed in 741us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117487.266567:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 58 00000100:00080000:3.0:1789117487.266604:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117487.271453:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117487.272066:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362435584 00000100:00100000:0.0:1789117487.272083:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362435584 00002000:00010000:0.0:1789117487.272145:0:6691:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1789117487.272152:0:6691:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c17a7d7bc00 with x1876025362435584 ext(0->18446744073709551615) 00002000:00010000:0.0:1789117487.272173:0:6691:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c17a7d7bc00. 00000100:00100000:0.0:1789117487.272217:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 5 00000100:00100000:0.0:1789117487.273331:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e0c4e520-7af6-449d-969f-b46035974613+8:2349:x1876025362435584:12345-192.168.206.37@tcp:10:bash.0 00002000:00010000:0.0:1789117487.276363:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789117487.276374:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789117483 -> 1789117486 00002000:00010000:0.0:1789117487.276378:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789117481 -> 1789117481 00002000:00010000:0.0:1789117487.276381:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789117483 -> 1789117486 00002000:00010000:0.0:1789117487.276424:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789117487.276542:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e0c4e520-7af6-449d-969f-b46035974613+9:2349:x1876025362435584:12345-192.168.206.37@tcp:10:bash.0 Request processed in 4307us (5095us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789117487.276557:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 5 00002000:00010000:0.0:1789117487.276565:0:6691:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1789117487.276569:0:6691:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c17a7d7bc00 with x1876025362435584 ext(0->18446744073709551615) 00002000:00010000:0.0:1789117487.276579:0:6691:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c17a7d7bc00. 00000100:00100000:1.0:1789117487.400125:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117487.400392:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362435712 00000100:00100000:3.0:1789117487.400457:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362435712 00000100:00100000:3.0:1789117487.400537:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 194 00000100:00100000:3.0:1789117487.400554:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+32:11760:x1876025362435712:12345-192.168.206.37@tcp:34:lfs.0 00010000:00010000:3.0:1789117487.400647:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e976 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.400666:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e976 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.400699:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e976 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.400717:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e97d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.400724:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.400730:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401110:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e984 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401120:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401127:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789117487.401177:0:7242:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401191:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e976 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401198:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e976 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401206:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e976 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401223:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117487.401227:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e976 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401247:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e976 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401261:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:3.0:1789117487.401264:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117487.401270:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e976 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401276:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460e976 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401292:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401299:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e97d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401305:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e97d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401309:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685400 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117487.401311:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e97d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401317:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e97d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401337:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c1782df4d00) 00010000:00010000:3.0:1789117487.401339:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117487.401342:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e97d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401348:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460e97d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401363:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401368:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e984 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401373:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e984 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401378:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2045600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117487.401380:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e984 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401385:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e984 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401391:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e400) 00010000:00010000:3.0:1789117487.401393:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117487.401395:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e984 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.401458:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e984 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117487.401574:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+32:11760:x1876025362435712:12345-192.168.206.37@tcp:34:lfs.0 Request processed in 1025us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117487.401583:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 194 00000100:00100000:0.0:1789117487.470568:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117487.470676:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362435968 00000100:00100000:1.0:1789117487.470690:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362435968 00000100:00100000:1.0:1789117487.470776:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 195 00000100:00100000:1.0:1789117487.470788:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0878b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+32:11763:x1876025362435968:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117487.470818:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117487.470866:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e98b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca85 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.470994:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e992 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.471012:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e992 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.471026:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e992 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.471044:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e999 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.471052:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.471058:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.471633:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e9a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.471646:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.471656:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117487.471668:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789117487.471792:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e992 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.471812:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e992 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.471819:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e992 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.471825:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117487.471830:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e992 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.471839:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e992 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.471854:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:1.0:1789117487.471858:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117487.471864:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e992 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.471870:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e992 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.471887:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.471892:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e999 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.471898:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e999 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.473184:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ee00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117487.473206:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e999 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.473216:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e999 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.473243:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c1788d9e200) 00010000:00010000:1.0:1789117487.473247:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117487.473252:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e999 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.473259:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e999 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.473344:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e98b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca85 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.473361:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e9a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca85 expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.473369:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e400) 00010000:00010000:1.0:1789117487.473371:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789117487.473374:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e800, rc 0) 00000100:00100000:1.0:1789117487.473493:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0878b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+34:11763:x1876025362435968:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 2706us (2939us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1789117487.473503:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 195 00000100:00100000:2.0:1789117487.477887:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117487.478159:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362436096 00000100:00100000:3.0:1789117487.478172:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362436096 00000100:00100000:3.0:1789117487.478263:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 196 00000100:00100000:3.0:1789117487.478276:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1781374b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+34:11763:x1876025362436096:12345-192.168.206.37@tcp:54:lfs.0 00010000:00010000:3.0:1789117487.478371:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e9ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.478391:0:7242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e953 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca70 expref: 34 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.478446:0:7242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e9ae lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.478496:0:7242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e953 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca70 expref: 34 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.478512:0:7242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e953 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca70 expref: 34 pid: 5839 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117487.478527:0:7242:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17a7d79a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7242:1876025385496320:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117487.478646:0:7242:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17852d1480 going to sleep for 11 seconds 00000100:00100000:3.0:1789117487.482607:0:7242:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17a7d79a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7242:1876025385496320:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117487.482659:0:7242:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e9ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117487.483783:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117487.484337:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362436352 00000100:00100000:0.0:1789117487.484349:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362436352 00000100:00100000:0.0:1789117487.484478:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 52 00000100:00100000:0.0:1789117487.484491:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1781374f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+35:5602:x1876025362436352:12345-192.168.206.37@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789117487.485188:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1781374f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+36:5602:x1876025362436352:12345-192.168.206.37@tcp:35:ldlm_bl.0 Request processed in 696us (1407us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789117487.485199:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 52 00000100:00100000:2.0:1789117487.490763:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117487.492130:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362436480 00000100:00100000:0.0:1789117487.492150:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362436480 00010000:00010000:0.0:1789117487.492221:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e953 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca70 expref: 36 pid: 5839 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117487.492288:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 79 00000100:00100000:0.0:1789117487.492300:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1781376940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+36:2350:x1876025362436480:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117487.492322:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117487.492331:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e953 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca70 expref: 36 pid: 5839 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.492371:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e953 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca70 expref: 36 pid: 5839 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.492421:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460e953 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca70 expref: 36 pid: 5839 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.492444:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e400) 00010000:00010000:0.0:1789117487.492451:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e9ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.492461:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e9ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.492471:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e9ae lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.492506:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117487.492585:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1781376940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+35:2350:x1876025362436480:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 287us (1840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117487.492593:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 79 00010000:00010000:3.0:1789117487.494205:0:7242:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e9ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.494224:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e9ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.494269:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e9ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.494277:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e9ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.494284:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e9ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.494290:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2045600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117487.494295:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e9ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.494303:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e9ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.494322:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e400) 00010000:00010000:3.0:1789117487.494325:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789117487.494331:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e9ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.494338:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e9ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117487.494471:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1781374b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+34:11763:x1876025362436096:12345-192.168.206.37@tcp:54:lfs.0 Request processed in 16193us (16597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117487.494496:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 196 00000100:00100000:2.0:1789117487.496973:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117487.497121:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362436736 00000100:00100000:3.0:1789117487.497137:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362436736 00000100:00100000:3.0:1789117487.497226:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 53 00000100:00100000:3.0:1789117487.497249:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1781376d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+34:11763:x1876025362436736:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:3.0:1789117487.497608:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1781376d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+35:11763:x1876025362436736:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 369us (658us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789117487.497617:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 53 00000100:00100000:2.0:1789117487.636927:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117487.637024:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362436992 00000100:00100000:0.0:1789117487.637037:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362436992 00000100:00100000:0.0:1789117487.637116:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 197 00000100:00100000:0.0:1789117487.637129:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1781374780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+35:11774:x1876025362436992:12345-192.168.206.37@tcp:101:cat.0 00010000:00010000:0.0:1789117487.637174:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117487.637205:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460e9b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca8c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.637333:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e9bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.637353:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e9bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.637366:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e9bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.637382:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e9c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.637388:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.637395:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.637829:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e9ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.637840:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e9ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.637848:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e9ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117487.637860:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1789117487.637992:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e9bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.638000:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e9bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.638015:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e9bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.638021:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117487.638026:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e9bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.638035:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e9bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.638049:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:0.0:1789117487.638053:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117487.638059:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e9bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.638065:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460e9bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.638078:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.638085:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e9c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.638090:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e9c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.638095:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbca00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117487.638098:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e9c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.638115:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e9c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.638124:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c1782c0e100) 00010000:00010000:0.0:1789117487.638126:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117487.638130:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e9c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.638136:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460e9c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.638188:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460e9b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca8c expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.638203:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e9ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca8c expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.638211:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e400) 00010000:00010000:0.0:1789117487.638213:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117487.638216:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbc000, rc 0) 00000100:00100000:0.0:1789117487.638304:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1781374780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+37:11774:x1876025362436992:12345-192.168.206.37@tcp:101:cat.0 Request processed in 1177us (1414us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789117487.638314:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 197 00000100:00100000:2.0:1789117487.647308:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117487.647537:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362437248 00000100:00100000:3.0:1789117487.647551:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362437248 00000100:00100000:3.0:1789117487.647624:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 54 00000100:00100000:3.0:1789117487.647636:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1781375a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+37:11774:x1876025362437248:12345-192.168.206.37@tcp:35:cat.0 00000100:00100000:3.0:1789117487.647976:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1781375a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+38:11774:x1876025362437248:12345-192.168.206.37@tcp:35:cat.0 Request processed in 340us (682us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1789117487.647985:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 54 00000100:00100000:2.0:1789117487.676904:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117487.677069:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362437504 00000100:00100000:1.0:1789117487.677083:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362437504 00000100:00100000:1.0:1789117487.677157:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 198 00000100:00100000:1.0:1789117487.677170:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1781375e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+38:11775:x1876025362437504:12345-192.168.206.37@tcp:36:rm.0 00010000:00010000:1.0:1789117487.677779:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789117487.677820:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc000/0xf7565228e460e9ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca8c expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.677936:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460e9a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca85 expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.678109:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460e968 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca77 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.678123:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e400) 00010000:00010000:1.0:1789117487.678136:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789117487.678164:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e9d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.678180:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e9d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.678191:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e9d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.678207:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e9df lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.678214:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e9df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.678222:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e9df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.679390:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e9e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.679435:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e9e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.679447:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e9e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789117487.681513:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1789117487.681530:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 334811129350ns, next at 335811125127ns, rc = 0 00010000:00010000:1.0:1789117487.681616:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fc00/0xf7565228e460e9ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.681633:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fc00/0xf7565228e460e9ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.681645:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fc00/0xf7565228e460e9ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.681654:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fc00/0xf7565228e460e9ed lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.681662:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fc00/0xf7565228e460e9ed lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.681669:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fc00/0xf7565228e460e9ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.682514:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789117487.682559:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e9e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.682582:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e9e6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.682589:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e9e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.682596:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117487.682601:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e9e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.682610:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e9e6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.682628:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e900) 00010000:00010000:1.0:1789117487.682631:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789117487.682638:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e9e6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.682645:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460e9e6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.682673:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e9d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.682679:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e9d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.682685:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e9d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.682690:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ec00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117487.682699:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e9d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.682706:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e9d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.682715:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:1.0:1789117487.682717:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117487.682720:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e9d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.682726:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460e9d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789117487.682738:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f46afd48 reply state 00000000929b3626 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e9df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117487.682748:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789117487.682951:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117487.682959:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fc00/0xf7565228e460e9ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117487.682966:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442fc00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117487.682970:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fc00/0xf7565228e460e9ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117487.682977:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fc00/0xf7565228e460e9ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117487.682986:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c1788d9e900) 00010000:00010000:2.0:1789117487.682989:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789117487.682992:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fc00/0xf7565228e460e9ed lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117487.682998:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fc00/0xf7565228e460e9ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117487.683018:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117487.683026:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117487.683028:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117487.683372:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1781375e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+37:11775:x1876025362437504:12345-192.168.206.37@tcp:36:rm.0 Request processed in 6198us (6476us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1789117487.683382:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 198 00010000:00010000:1.0:1789117487.685779:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e9df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.685801:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e9df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.685809:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e9df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.685817:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ee00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117487.685822:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e9df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.685852:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e9df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.685872:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c1788d9e200) 00010000:00010000:1.0:1789117487.685875:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117487.685881:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e9df lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.685888:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460e9df lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117487.686705:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1781377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385496704:0@lo:400:kworker.0 00000100:00100000:2.0:1789117487.686782:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117487.686817:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1781374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876025385496576:0@lo:400:kworker.0 00000100:00100000:0.0:1789117487.686850:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117487.686889:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385496704 00000100:00100000:0.0:1789117487.686899:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385496704 00000100:00100000:3.0:1789117487.686987:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1781377840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385496832:0@lo:400:kworker.0 00000100:00100000:0.0:1789117487.686988:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385496576 00000100:00100000:0.0:1789117487.686991:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385496576 00000100:00100000:0.0:1789117487.687014:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789117487.687023:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17813770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385496704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117487.687025:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789117487.687067:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117487.687085:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789117487.687093:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c08783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876025385496576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117487.687098:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17813770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385496704:12345-0@lo:400:kworker.0 Request processed in 76us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117487.687106:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789117487.687128:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c08783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876025385496576:12345-0@lo:400:kworker.0 Request processed in 36us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117487.687132:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385496832 00000100:00100000:3.0:1789117487.687134:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789117487.687135:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385496832 00000100:00100000:1.0:1789117487.687465:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17813752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385496448:0@lo:400:kworker.0 00000100:00100000:1.0:1789117487.687507:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117487.687591:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1781377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385496704:0@lo:400:kworker.0 00000100:00080000:3.0:1789117487.687681:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117487.687715:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1781374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876025385496576:0@lo:400:kworker.0 00000100:00100000:3.0:1789117487.687721:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17813761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385497088:0@lo:400:kworker.0 00000100:00100000:3.0:1789117487.687748:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117487.689358:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385497088 00000100:00100000:0.0:1789117487.689375:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385497088 00000100:00100000:0.0:1789117487.689674:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789117487.689688:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876025385496832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117487.690109:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1781377840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385496832:0@lo:400:kworker.0 00000100:00100000:3.0:1789117487.690140:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789117487.690150:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a7d7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1876025385497088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117487.690175:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876025385496832:12345-0@lo:400:kworker.0 Request processed in 93us (2749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117487.690188:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789117487.690199:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a7d7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1876025385497088:12345-0@lo:400:kworker.0 Request processed in 51us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117487.690208:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1789117487.690228:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117487.690323:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17813761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385497088:0@lo:400:kworker.0 00000100:00100000:1.0:1789117487.691743:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1781376580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385496960:0@lo:400:kworker.0 00000100:00100000:1.0:1789117487.691821:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117487.691930:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385496960 00000100:00100000:2.0:1789117487.691939:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385496960 00000100:00100000:2.0:1789117487.692022:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789117487.692033:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1683959e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385496960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117487.692091:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1683959e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385496960:12345-0@lo:400:kworker.0 Request processed in 60us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117487.692099:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:1.0:1789117487.692164:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117487.692193:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1781376580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385496960:0@lo:400:kworker.0 00000100:00100000:0.0:1789117487.695721:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385496448 00000100:00100000:0.0:1789117487.695739:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385496448 00000100:00100000:0.0:1789117487.695888:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1789117487.695901:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3298:x1876025385496448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117487.696041:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3298:x1876025385496448:12345-0@lo:400:kworker.0 Request processed in 143us (8533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117487.696050:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789117487.696145:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17813752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385496448:0@lo:400:kworker.0 00000100:00100000:2.0:1789117487.761471:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117487.761619:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362437760 00000100:00100000:3.0:1789117487.761632:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362437760 00000100:00100000:3.0:1789117487.761703:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 199 00000100:00100000:3.0:1789117487.761714:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1781377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+36:11781:x1876025362437760:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:3.0:1789117487.761746:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117487.761771:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e9f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca93 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.762065:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460e9fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.762085:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460e9fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.762098:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460e9fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.762137:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ea02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.762145:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ea02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.762152:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ea02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789117487.763805:0:7242:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1789117487.764824:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460ea09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.764847:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460ea09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.764860:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460ea09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.764928:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460e9fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.764936:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460e9fb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.764945:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460e9fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.764952:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2044200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117487.764956:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460e9fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.764981:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460e9fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.764998:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:3.0:1789117487.765001:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117487.765007:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460e9fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.765013:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460e9fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789117487.765033:0:7242:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000007d86bdd3 reply state 00000000bbf9f403 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ea02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117487.765043:0:7242:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789117487.765084:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460e9f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca93 expref: 39 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.765102:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460ea09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca93 expref: 38 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.765111:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:3.0:1789117487.765113:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789117487.765115:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781684c00, rc 0) 00000100:00100000:3.0:1789117487.765222:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1781377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+39:11781:x1876025362437760:12345-192.168.206.37@tcp:101:bash.0 Request processed in 3509us (3765us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1789117487.765242:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 199 00010000:00010000:3.0:1789117487.767367:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ea02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.767429:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ea02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.767439:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ea02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.767447:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2045000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117487.767453:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ea02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.767462:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ea02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.767480:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c1782df4d00) 00010000:00010000:3.0:1789117487.767483:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117487.767488:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ea02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117487.767495:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ea02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117487.774140:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117487.777863:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362437888 00000100:00100000:0.0:1789117487.777881:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362437888 00000100:00100000:0.0:1789117487.778205:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 59 00000100:00100000:0.0:1789117487.778220:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1781375680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+5:2351:x1876025362437888:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:0.0:1789117487.778272:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117487.778300:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cae41405/0xf7565228e460ea17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ca9a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789117487.778333:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789117487.778358:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=334s v=(0 0) 00010000:00010000:0.0:1789117487.778364:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117487.778375:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cae41405/0xf7565228e460ea17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca9a expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.778422:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cae41405/0xf7565228e460ea17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca9a expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.778439:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbc200, rc 0) 00000100:00100000:0.0:1789117487.778534:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1781375680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+6:2351:x1876025362437888:12345-192.168.206.37@tcp:101:bash.0 Request processed in 317us (4409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117487.778543:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 59 00000100:00100000:2.0:1789117487.787293:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117487.787726:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362438016 00000100:00100000:0.0:1789117487.787741:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362438016 00000100:00100000:0.0:1789117487.788171:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 60 00000100:00100000:0.0:1789117487.788184:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1781377c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+6:11781:x1876025362438016:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:0.0:1789117487.788207:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117487.788231:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087698202/0xf7565228e460ea1e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9caa1 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.788276:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cae41405/0xf7565228e460ea17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca9a expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.788315:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117487.788320:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117487.788327:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087698202/0xf7565228e460ea1e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caa1 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.788376:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cae41405/0xf7565228e460ea17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca9a expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.788453:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cae41405/0xf7565228e460ea17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca9a expref: 7 pid: 6685 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117487.788483:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0879a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1876025385497216:192.168.206.37@tcp:104: 00000100:00100000:0.0:1789117487.788617:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b87e2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789117487.792578:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117487.794212:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362438144 00000100:00100000:1.0:1789117487.794225:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362438144 00000100:00100000:0.0:1789117487.794234:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0879a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1876025385497216:192.168.206.37@tcp:104: 00010000:00010000:1.0:1789117487.794275:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cae41405/0xf7565228e460ea17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca9a expref: 8 pid: 6685 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.794275:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000087698202/0xf7565228e460ea1e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caa1 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.794301:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbca00, rc 0) 00000100:00100000:1.0:1789117487.794327:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 80 00000100:00100000:1.0:1789117487.794337:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17813743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+8:2350:x1876025362438144:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117487.794355:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117487.794417:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cae41405/0xf7565228e460ea17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca9a expref: 8 pid: 6685 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.794431:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cae41405/0xf7565228e460ea17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca9a expref: 8 pid: 6685 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.794458:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cae41405/0xf7565228e460ea17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca9a expref: 8 pid: 6685 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.794475:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117487.794480:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1789117487.794511:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1781377c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+7:11781:x1876025362438016:12345-192.168.206.37@tcp:101:bash.0 Request processed in 6329us (7242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117487.794520:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 60 00010000:00010000:1.0:1789117487.794548:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000087698202/0xf7565228e460ea1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caa1 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.794561:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087698202/0xf7565228e460ea1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caa1 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117487.794603:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000087698202/0xf7565228e460ea1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caa1 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117487.794618:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c05d30c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5827:1876025385497344:192.168.206.37@tcp:105: 00000100:00100000:1.0:1789117487.794678:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1784fb9780 going to sleep for 11 seconds 00000100:00100000:2.0:1789117487.801390:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117487.801893:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362438400 00000100:00100000:3.0:1789117487.801906:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362438400 00000100:00100000:3.0:1789117487.802900:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 55 00000100:00100000:3.0:1789117487.802929:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17813752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+38:11781:x1876025362438400:12345-192.168.206.37@tcp:35:bash.0 00000100:00100000:3.0:1789117487.803427:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17813752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+39:11781:x1876025362438400:12345-192.168.206.37@tcp:35:bash.0 Request processed in 514us (2049us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789117487.803437:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 55 00000100:00100000:0.0:1789117487.816521:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c05d30c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5827:1876025385497344:192.168.206.37@tcp:105: 00010000:00010000:0.0:1789117487.816561:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117487.816690:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17813743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+6:2350:x1876025362438144:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 22352us (24125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117487.816703:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 80 00010000:00010000:3.0:1789117487.942856:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117487.998188:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117487.998475:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362438528 00000100:00100000:0.0:1789117487.998493:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362438528 00000100:00100000:0.0:1789117487.998581:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 200 00000100:00100000:0.0:1789117487.998593:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1781376580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+39:11797:x1876025362438528:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:0.0:1789117487.998626:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117487.998651:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9caa8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.998748:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460ea2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.998766:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460ea2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117487.998779:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460ea2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117487.999313:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1789117487.999320:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789117488.001554:0:5839:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460ea2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.001721:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caa8 expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.001750:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460ea2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caa8 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.002198:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:0.0:1789117488.002203:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789117488.002208:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbc800, rc 0) 00000100:00100000:0.0:1789117488.002314:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1781376580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+40:11797:x1876025362438528:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 3720us (4133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117488.002324:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 200 00000100:00100000:2.0:1789117488.010181:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117488.015507:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362438784 00000100:00100000:0.0:1789117488.015526:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362438784 00000100:00100000:0.0:1789117488.015717:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 201 00000100:00100000:0.0:1789117488.015732:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17813761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+40:11797:x1876025362438784:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:0.0:1789117488.015769:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117488.015806:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9caaf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.020026:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460ea3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.020068:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460ea3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.020084:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460ea3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117488.020102:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789117488.020450:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caaf expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.020504:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460ea3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caaf expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.020515:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:0.0:1789117488.020518:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117488.020522:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbce00, rc 0) 00000100:00100000:0.0:1789117488.020624:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17813761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+42:11797:x1876025362438784:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 4896us (10457us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1789117488.020636:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 201 00000100:00080000:1.0:1789117488.024646:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117488.027258:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117488.027386:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117488.027518:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362439040 00000100:00100000:2.0:1789117488.027529:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362439040 00000100:00100000:2.0:1789117488.027637:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 202 00000100:00100000:2.0:1789117488.027651:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+42:11797:x1876025362439040:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:2.0:1789117488.027685:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117488.027712:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460ea48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cab6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117488.027714:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362439168 00000100:00100000:3.0:1789117488.027722:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362439168 00000100:00100000:3.0:1789117488.027778:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 14 00000100:00100000:3.0:1789117488.027787:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+44:2349:x1876025362439168:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117488.027799:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117488.027824:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460ea3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caaf expref: 44 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.027843:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:3.0:1789117488.027850:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117488.027946:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+43:2349:x1876025362439168:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 160us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117488.027955:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 14 00010000:00010000:2.0:1789117488.028119:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ea4f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.028135:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ea4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.028147:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ea4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117488.028162:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789117488.028511:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460ea48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cab6 expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.028529:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ea4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cab6 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.028537:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:2.0:1789117488.028541:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789117488.028543:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f600, rc 0) 00000100:00100000:2.0:1789117488.028590:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+43:11797:x1876025362439040:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 943us (1204us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789117488.028598:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 202 00000100:00100000:1.0:1789117488.033088:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117488.034830:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362439296 00000100:00100000:3.0:1789117488.034850:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362439296 00000100:00100000:3.0:1789117488.035218:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 61 00000100:00100000:3.0:1789117488.035244:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+6:2352:x1876025362439296:12345-192.168.206.37@tcp:1:lfs.0 00010000:00010000:3.0:1789117488.035302:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd11b1fb/0xf7565228e460ea5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.035326:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000087698202/0xf7565228e460ea1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caa1 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.035336:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789117488.035342:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789117488.035347:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd11b1fb/0xf7565228e460ea5d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.035449:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000087698202/0xf7565228e460ea1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caa1 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.035467:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000087698202/0xf7565228e460ea1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caa1 expref: 6 pid: 6687 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117488.035488:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ce580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6686:1876025385497472:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117488.035662:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17852d1480 going to sleep for 11 seconds 00000100:00080000:1.0:1789117488.039886:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117488.047945:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117488.048137:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362439424 00000100:00100000:1.0:1789117488.048149:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362439424 00002000:00100000:1.0:1789117488.048216:0:6690:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9c1781377840 x1876025362439424/t0(0) o4->e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp:39/0 lens 504/0 e 0 to 0 dl 1789117499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1789117488.048221:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ce580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6686:1876025385497472:192.168.206.37@tcp:104: 00002000:00100000:1.0:1789117488.048236:0:6690:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1781377840 with x1876025362439424 ext(0->8) 00010000:00010000:1.0:1789117488.048247:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000087698202/0xf7565228e460ea1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caa1 expref: 7 pid: 6687 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.048265:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000087698202/0xf7565228e460ea1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caa1 expref: 7 pid: 6687 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.048266:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fd11b1fb/0xf7565228e460ea5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789117488.048274:0:6690:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c1781377840 00000100:00100000:1.0:1789117488.048313:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 3 00000100:00100000:1.0:1789117488.048324:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1781377840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e0c4e520-7af6-449d-969f-b46035974613+7:2350:x1876025362439424:12345-192.168.206.37@tcp:4:lfs.0 00000100:00100000:1.0:1789117488.048944:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1781377840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e0c4e520-7af6-449d-969f-b46035974613+9:2350:x1876025362439424:12345-192.168.206.37@tcp:4:lfs.0 Request processed in 618us (1011us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789117488.048955:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 3 00002000:00100000:1.0:1789117488.048965:0:6690:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9c1781377840 x1876025362439424/t4294967308(0) o4->e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp:39/0 lens 504/448 e 0 to 0 dl 1789117499 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117488.048976:0:6690:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1781377840 with x1876025362439424 ext(0->8) 00010000:00010000:1.0:1789117488.048983:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000087698202/0xf7565228e460ea1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caa1 expref: 9 pid: 6687 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.048997:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000087698202/0xf7565228e460ea1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caa1 expref: 9 pid: 6687 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789117488.049019:0:6690:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c1781377840 00000100:00100000:2.0:1789117488.053228:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117488.053511:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362439552 00000100:00100000:3.0:1789117488.053525:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362439552 00010000:00010000:3.0:1789117488.053587:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000087698202/0xf7565228e460ea1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caa1 expref: 9 pid: 6687 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117488.053687:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 81 00000100:00100000:3.0:1789117488.053700:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1781374000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+9:2349:x1876025362439552:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117488.053722:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789117488.053748:0:7638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789117488.053752:0:7638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789117486 00002000:00010000:3.0:1789117488.053755:0:7638:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789117487 00002000:00010000:3.0:1789117488.053757:0:7638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789117486 00010000:00010000:3.0:1789117488.053781:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000087698202/0xf7565228e460ea1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caa1 expref: 9 pid: 6687 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.053797:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000087698202/0xf7565228e460ea1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caa1 expref: 9 pid: 6687 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.053826:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087698202/0xf7565228e460ea1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caa1 expref: 9 pid: 6687 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.053847:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789117488.053853:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789117488.053860:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd11b1fb/0xf7565228e460ea5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.053871:0:7638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd11b1fb/0xf7565228e460ea5d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.053940:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117488.054020:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1781374000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+8:2349:x1876025362439552:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 322us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117488.054029:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 81 00010000:00010000:1.0:1789117488.054686:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fd11b1fb/0xf7565228e460ea5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.054701:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd11b1fb/0xf7565228e460ea5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.054737:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd11b1fb/0xf7565228e460ea5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.054746:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd11b1fb/0xf7565228e460ea5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.054754:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd11b1fb/0xf7565228e460ea5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.054761:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685400 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:1.0:1789117488.054766:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd11b1fb/0xf7565228e460ea5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.054775:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd11b1fb/0xf7565228e460ea5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.054789:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd11b1fb/0xf7565228e460ea5d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.054814:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd11b1fb/0xf7565228e460ea5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117488.054924:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+7:2352:x1876025362439296:12345-192.168.206.37@tcp:1:lfs.0 Request processed in 19684us (21843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117488.054934:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 61 00000100:00100000:2.0:1789117488.060439:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117488.061555:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362439808 00000100:00100000:3.0:1789117488.061574:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362439808 00000100:00100000:3.0:1789117488.061656:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 56 00000100:00100000:3.0:1789117488.061669:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a9732050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+43:11797:x1876025362439808:12345-192.168.206.37@tcp:35:lfs.0 00000004:00010000:3.0:1789117488.061759:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ea4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cab6 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789117488.062246:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1789117488.062294:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1789117488.062705:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:3.0:1789117488.062766:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460ea64 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.062783:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460ea09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca93 expref: 47 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.062794:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460ea64 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.062840:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460ea09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca93 expref: 47 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.062859:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460ea09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca93 expref: 47 pid: 7242 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117488.062875:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ce580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1876025385497600:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117488.068824:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a9764a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789117488.081270:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117488.081435:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362439936 00000100:00100000:0.0:1789117488.081447:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362439936 00010000:00010000:0.0:1789117488.081499:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460ea09 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca93 expref: 48 pid: 7242 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117488.081539:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 82 00000100:00100000:0.0:1789117488.081550:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17845e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+48:2350:x1876025362439936:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117488.081568:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117488.081576:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460ea09 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca93 expref: 48 pid: 7242 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.081591:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460ea09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca93 expref: 48 pid: 7242 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.081618:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:0.0:1789117488.081624:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460ea64 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.081653:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460ea64 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.081663:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460ea64 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.081688:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117488.081761:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17845e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+48:2350:x1876025362439936:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 211us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117488.081770:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 82 00010000:00010000:3.0:1789117488.081946:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460ea09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca93 expref: 47 pid: 7242 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117488.081965:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ce580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1876025385497600:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117488.081994:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460ea64 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.082013:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460ea64 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.082019:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460ea64 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789117488.082172:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1789117488.082467:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1789117488.082603:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ce580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1876025385497728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789117488.082668:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117488.082700:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17852d1780 going to sleep for 11 seconds 00000100:00100000:2.0:1789117488.083008:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385497728 00000100:00100000:2.0:1789117488.083030:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385497728 00000100:00100000:2.0:1789117488.083086:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789117488.083097:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1876025385497728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789117488.083195:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1876025385497728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 100us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117488.083202:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789117488.084170:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ce580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1876025385497728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789117488.084874:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1789117488.085010:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ce580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1876025385497856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789117488.085082:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117488.085130:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a9764a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789117488.088707:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385497856 00000100:00100000:2.0:1789117488.088726:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385497856 00000100:00100000:2.0:1789117488.088814:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789117488.088828:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1876025385497856:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789117488.089225:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5842:x1876025385497856:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 399us (4141us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789117488.089235:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789117488.092151:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ce580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1876025385497856:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789117488.092330:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1789117488.092462:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460ea64 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.092474:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460ea64 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.092483:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460ea64 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.092489:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781685600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117488.092515:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460ea64 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.092525:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460ea64 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.092546:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:3.0:1789117488.092549:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789117488.092555:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460ea64 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.092562:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460ea64 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789117488.092849:0:5842:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789117488.092997:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1789117488.093011:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 335222610833ns, next at 336222607711ns, rc = 0 00000001:00080000:3.0:1789117488.093018:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1789117488.093062:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:3.0:1789117488.093065:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789117488.093074:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ea4f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cab6 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117488.093262:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a9732050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+50:11797:x1876025362439808:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 31594us (32869us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1789117488.093275:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 56 00000020:00080000:3.0:1789117488.093284:0:5842:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789117488.099554:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117488.099652:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362440064 00000100:00100000:3.0:1789117488.099665:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362440064 00000100:00100000:3.0:1789117488.099787:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 203 00000100:00100000:3.0:1789117488.099799:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1781374f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+50:11797:x1876025362440064:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:3.0:1789117488.099852:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117488.099884:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460ea6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cabd expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.099984:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460ea6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cabd expref: 51 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.100002:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460ea6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cabd expref: 51 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.100025:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:3.0:1789117488.100029:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789117488.100033:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685600, rc 0) 00000100:00100000:3.0:1789117488.100115:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1781374f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+51:11797:x1876025362440064:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 319us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117488.100123:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 203 00000100:00100000:2.0:1789117488.111988:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117488.112118:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362440320 00000100:00100000:1.0:1789117488.112132:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362440320 00000100:00100000:1.0:1789117488.112215:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 57 00000100:00100000:1.0:1789117488.112229:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1781376d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+51:11797:x1876025362440320:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:1.0:1789117488.112594:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1781376d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+52:11797:x1876025362440320:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 366us (624us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1789117488.112603:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 57 00000100:00100000:2.0:1789117488.197995:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385497984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117488.198107:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117488.198221:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117488.198237:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c05d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385498112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117488.198265:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117488.198448:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385497984 00000100:00100000:1.0:1789117488.198458:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385497984 00000100:00100000:1.0:1789117488.198505:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385498112 00000100:00100000:1.0:1789117488.198508:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385498112 00000100:00100000:1.0:1789117488.198526:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789117488.198535:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1781375a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1876025385497984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117488.198564:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117488.198615:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1781375a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1876025385497984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117488.198623:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789117488.198644:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789117488.198650:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17813752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876025385498112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117488.198694:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117488.198722:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17813752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876025385498112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117488.198728:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789117488.198822:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c05d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385498112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117488.198838:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385497984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117488.214961:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117488.216480:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362440448 00000100:00100000:0.0:1789117488.216497:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362440448 00000100:00100000:0.0:1789117488.216592:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 204 00000100:00100000:0.0:1789117488.216606:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1781376940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+52:11807:x1876025362440448:12345-192.168.206.37@tcp:34:lfs.0 00010000:00010000:0.0:1789117488.216720:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea72 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.216742:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.216759:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.216779:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ea79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.216787:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ea79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.216794:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ea79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.216953:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460ea80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.216963:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460ea80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.216971:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460ea80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789117488.217022:0:5839:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460ea80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.217036:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.217043:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea72 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.217050:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.217055:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117488.217060:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.217068:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea72 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.217083:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:0.0:1789117488.217086:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117488.217091:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.217105:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.217121:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ea79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.217128:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ea79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.217134:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ea79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.217150:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbca00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117488.217153:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ea79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.217160:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ea79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.217170:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c1782c0ef00) 00010000:00010000:0.0:1789117488.217173:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117488.217175:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ea79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.217182:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ea79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.217198:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460ea80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.217217:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460ea80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.217874:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460ea80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.217881:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbce00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117488.217885:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460ea80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.217892:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460ea80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.217903:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:0.0:1789117488.217905:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117488.217908:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460ea80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.218117:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460ea80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117488.221052:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1781376940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+52:11807:x1876025362440448:12345-192.168.206.37@tcp:34:lfs.0 Request processed in 4432us (6089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117488.221071:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 204 00000100:00100000:2.0:1789117488.268779:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117488.270710:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362440704 00000100:00100000:0.0:1789117488.270729:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362440704 00000100:00100000:0.0:1789117488.271026:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 205 00000100:00100000:0.0:1789117488.271041:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17813743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+52:11810:x1876025362440704:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:0.0:1789117488.271070:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117488.271098:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460ea87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cac4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.271236:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ea8e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.271255:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ea8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.271268:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ea8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.271285:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.271291:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.271298:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.271792:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460ea9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.271803:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460ea9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.271811:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460ea9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117488.271825:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789117488.271973:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ea8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.271982:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ea8e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.271999:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ea8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.272006:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbca00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117488.272021:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ea8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.272031:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ea8e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.272047:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:0.0:1789117488.272050:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117488.272055:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ea8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.272062:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ea8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.272078:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.272084:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.272089:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.272094:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117488.272097:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.272114:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.272122:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c1782c0ef00) 00010000:00010000:0.0:1789117488.272125:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117488.272128:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.272133:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ea95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.272196:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460ea87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cac4 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.272211:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460ea9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cac4 expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.272220:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:0.0:1789117488.272223:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117488.272225:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbc200, rc 0) 00000100:00100000:0.0:1789117488.272322:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17813743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+54:11810:x1876025362440704:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 1285us (3557us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789117488.272332:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 205 00000100:00100000:2.0:1789117488.282799:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117488.282952:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362440832 00000100:00100000:3.0:1789117488.282963:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362440832 00000100:00100000:3.0:1789117488.283041:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 206 00000100:00100000:3.0:1789117488.283054:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1781374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+54:11810:x1876025362440832:12345-192.168.206.37@tcp:54:lfs.0 00010000:00010000:3.0:1789117488.283157:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460eaaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.283182:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460eaaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.283196:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460eaaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.284625:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460eaaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.284634:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460eaaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.284642:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460eaaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.284649:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1781684c00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117488.284655:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460eaaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.284664:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460eaaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.284683:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:3.0:1789117488.284687:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789117488.284692:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460eaaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.284699:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460eaaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117488.284819:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1781374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+54:11810:x1876025362440832:12345-192.168.206.37@tcp:54:lfs.0 Request processed in 1762us (2031us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117488.284830:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 206 00000100:00100000:2.0:1789117488.291761:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117488.292036:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362441088 00000100:00100000:3.0:1789117488.292049:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362441088 00000100:00100000:3.0:1789117488.292119:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 58 00000100:00100000:3.0:1789117488.292138:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+54:11810:x1876025362441088:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:3.0:1789117488.292497:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+55:11810:x1876025362441088:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 360us (750us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1789117488.292506:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 58 00000100:00100000:2.0:1789117488.386539:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117488.386637:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362441344 00000100:00100000:3.0:1789117488.386650:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362441344 00000100:00100000:3.0:1789117488.386809:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 207 00000100:00100000:3.0:1789117488.386823:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0257840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+55:11820:x1876025362441344:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:3.0:1789117488.386856:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117488.386860:0:7242:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789117488.386896:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460ea2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caa8 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.386927:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:3.0:1789117488.386933:0:7242:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789117488.386950:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460eab1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cacb expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.387078:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eab8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.387094:0:7242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460ea9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cac4 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.387104:0:7242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eab8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.387145:0:7242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460ea9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cac4 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.387181:0:7242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460ea9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cac4 expref: 55 pid: 5840 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117488.387197:0:7242:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7242:1876025385498240:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117488.387630:0:7242:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f43600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117488.392463:0:7242:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7242:1876025385498240:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117488.392506:0:7242:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eab8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117488.393309:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117488.393767:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362441472 00000100:00100000:0.0:1789117488.393778:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362441472 00010000:00010000:0.0:1789117488.393844:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460ea9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cac4 expref: 56 pid: 5840 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117488.393932:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 83 00000100:00100000:0.0:1789117488.393944:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0256580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+56:2349:x1876025362441472:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117488.393964:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117488.393972:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460ea9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cac4 expref: 56 pid: 5840 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.393986:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460ea9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cac4 expref: 56 pid: 5840 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.394014:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460ea9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cac4 expref: 56 pid: 5840 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.394030:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:0.0:1789117488.394037:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eab8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.394047:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eab8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.394056:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eab8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.394100:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117488.394172:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0256580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+55:2349:x1876025362441472:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 229us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117488.394180:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 83 00010000:00010000:1.0:1789117488.394326:0:7242:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eab8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.394348:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eab8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117488.394372:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789117488.394593:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460eab1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cacb expref: 56 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.394612:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eab8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cacb expref: 55 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.394621:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:1.0:1789117488.394624:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789117488.394627:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685400, rc 0) 00000100:00100000:1.0:1789117488.394675:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0257840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+55:11820:x1876025362441344:12345-192.168.206.37@tcp:101:bash.0 Request processed in 7855us (8149us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1789117488.394683:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 207 00000100:00100000:2.0:1789117488.400347:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117488.400455:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362441728 00000100:00100000:0.0:1789117488.400485:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362441728 00000100:00100000:0.0:1789117488.400554:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 208 00000100:00100000:0.0:1789117488.400565:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+55:11820:x1876025362441728:12345-192.168.206.37@tcp:36:bash.0 00010000:00010000:0.0:1789117488.400922:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460eac6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.400944:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460eac6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.400959:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460eac6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789117488.401027:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1789117488.401055:0:5839:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001b2b5f78 reply state 000000006a60e492 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460eac6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117488.401063:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789117488.401177:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+58:11820:x1876025362441728:12345-192.168.206.37@tcp:36:bash.0 Request processed in 613us (842us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1789117488.401185:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 208 00000020:00080000:0.0:1789117488.401191:0:5839:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789117488.403299:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460eac6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.403318:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460eac6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.403345:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460eac6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.403352:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbc200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117488.403358:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460eac6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.403367:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460eac6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.403385:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:1.0:1789117488.403389:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117488.403395:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460eac6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.403451:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc200/0xf7565228e460eac6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117488.405339:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117488.407075:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362441856 00000100:00100000:0.0:1789117488.407093:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362441856 00000100:00100000:0.0:1789117488.407201:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 209 00000100:00100000:0.0:1789117488.407213:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+57:11820:x1876025362441856:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:0.0:1789117488.407252:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117488.407277:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460eacd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cad2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.407378:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ead4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.407425:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eab8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cacb expref: 58 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.407435:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ead4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.407477:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eab8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cacb expref: 58 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.407492:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eab8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cacb expref: 58 pid: 7242 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117488.407508:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0879a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876025385498368:192.168.206.37@tcp:104: 00000100:00100000:0.0:1789117488.407611:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b87e2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117488.410645:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0879a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876025385498368:192.168.206.37@tcp:104: 00010000:00010000:0.0:1789117488.410687:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ead4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117488.411671:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117488.411939:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362441984 00000100:00100000:0.0:1789117488.411948:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362441984 00010000:00010000:0.0:1789117488.411995:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eab8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cacb expref: 59 pid: 7242 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117488.412042:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 84 00000100:00100000:0.0:1789117488.412053:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0255680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+59:2350:x1876025362441984:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117488.412072:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117488.412099:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eab8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cacb expref: 59 pid: 7242 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.412114:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eab8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cacb expref: 59 pid: 7242 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.412142:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eab8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cacb expref: 59 pid: 7242 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.412160:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:0.0:1789117488.412166:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ead4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.412177:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ead4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.412185:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ead4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117488.412232:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117488.412299:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0255680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+58:2350:x1876025362441984:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 248us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117488.412307:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 84 00010000:00010000:2.0:1789117488.412761:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ead4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.412772:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ead4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117488.412831:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789117488.412837:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789117488.412860:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ead4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.412900:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbce00/0xf7565228e460eacd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cad2 expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.412931:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ead4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cad2 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.412940:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:2.0:1789117488.412943:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117488.412945:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbd600, rc 0) 00000100:00100000:2.0:1789117488.412986:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+57:11820:x1876025362441856:12345-192.168.206.37@tcp:101:bash.0 Request processed in 5775us (7660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117488.412994:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 209 00000100:00100000:2.0:1789117488.421292:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117488.424327:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362442240 00000100:00100000:3.0:1789117488.424346:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362442240 00000100:00100000:3.0:1789117488.424520:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 59 00000100:00100000:3.0:1789117488.424535:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0257c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+57:11820:x1876025362442240:12345-192.168.206.37@tcp:35:bash.0 00000100:00100000:3.0:1789117488.425118:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0257c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+58:11820:x1876025362442240:12345-192.168.206.37@tcp:35:bash.0 Request processed in 573us (3827us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1789117488.425134:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 59 00000100:00100000:0.0:1789117488.545942:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117488.546111:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362442368 00000100:00100000:2.0:1789117488.546134:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362442368 00000100:00100000:2.0:1789117488.546194:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 210 00000100:00100000:2.0:1789117488.546204:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0879a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+58:11826:x1876025362442368:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:2.0:1789117488.546227:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117488.546247:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460eadb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cad9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.546307:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eae2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.546321:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.546331:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117488.546431:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1789117488.546435:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789117488.546460:0:5839:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.546484:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460eadb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cad9 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.546501:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eae2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cad9 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.546510:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:2.0:1789117488.546513:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789117488.546516:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f600, rc 0) 00000100:00100000:2.0:1789117488.546590:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0879a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+59:11826:x1876025362442368:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 388us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117488.546597:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 210 00000100:00100000:2.0:1789117488.555571:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117488.555839:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362442496 00000100:00100000:1.0:1789117488.556336:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362442496 00000100:00100000:1.0:1789117488.556515:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 211 00000100:00100000:1.0:1789117488.556525:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+59:11826:x1876025362442496:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117488.556544:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117488.556561:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460eae9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cae0 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.559664:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460eaf0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.559685:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460eaf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.559765:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460eaf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.559785:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460eaf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.559793:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460eaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.559800:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460eaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.560366:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460eafe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.560377:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460eafe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.560384:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460eafe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117488.560610:0:7242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789117488.560615:0:7242:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789117488.560635:0:7242:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460eafe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.560647:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460eafe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.560656:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460eaf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.560677:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460eaf0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.560684:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460eaf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.560690:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117488.560694:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460eaf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.560703:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460eaf0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.561509:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:1.0:1789117488.561512:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117488.561518:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460eaf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.561524:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460eaf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.561540:0:7242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460eaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.561546:0:7242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460eaf7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.561551:0:7242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460eaf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.561556:0:7242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117488.561568:0:7242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460eaf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.561575:0:7242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460eaf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.561584:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c1788d9e200) 00010000:00010000:1.0:1789117488.561587:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117488.561590:0:7242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460eaf7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.561595:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460eaf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.561636:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460eae9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cae0 expref: 61 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.561649:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460eafe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cae0 expref: 60 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.561656:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:1.0:1789117488.561658:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117488.561660:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442ec00, rc 0) 00000100:00100000:1.0:1789117488.562332:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+60:11826:x1876025362442496:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 5802us (6763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117488.562342:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 211 00000100:00100000:1.0:1789117488.566493:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117488.566711:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362442624 00000100:00100000:2.0:1789117488.566720:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362442624 00000100:00100000:2.0:1789117488.566787:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 15 00000100:00100000:2.0:1789117488.566798:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+60:2350:x1876025362442624:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117488.566815:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117488.566840:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ec00/0xf7565228e460eafe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cae0 expref: 60 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.566878:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:2.0:1789117488.566883:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117488.566994:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+59:2350:x1876025362442624:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 196us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117488.567002:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 15 00000100:00100000:0.0:1789117488.571489:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117488.571544:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362442880 00000100:00100000:2.0:1789117488.571553:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362442880 00000100:00100000:2.0:1789117488.571607:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 212 00000100:00100000:2.0:1789117488.571617:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c087b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+59:11826:x1876025362442880:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:2.0:1789117488.571636:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117488.571656:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460eb05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cae7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.572188:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460eb0c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.572221:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ead4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cad2 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.572229:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460eb0c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.572265:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ead4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cad2 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.572279:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ead4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cad2 expref: 60 pid: 5840 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117488.572292:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0254b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876025385498496:192.168.206.37@tcp:104: 00000100:00100000:2.0:1789117488.572457:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681f1df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789117488.576341:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0254b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876025385498496:192.168.206.37@tcp:104: 00010000:00010000:2.0:1789117488.576373:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460eb0c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117488.578729:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117488.579076:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362443008 00000100:00100000:3.0:1789117488.579086:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362443008 00010000:00010000:3.0:1789117488.579132:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ead4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cad2 expref: 61 pid: 5840 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117488.579177:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 85 00000100:00100000:3.0:1789117488.579185:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b86b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+61:2352:x1876025362443008:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117488.579199:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117488.579221:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ead4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cad2 expref: 61 pid: 5840 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.579240:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ead4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cad2 expref: 61 pid: 5840 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.579263:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460ead4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cad2 expref: 61 pid: 5840 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.579278:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:3.0:1789117488.579283:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460eb0c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.579291:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460eb0c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.579297:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460eb0c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.579325:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117488.579393:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b86b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+60:2352:x1876025362443008:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 207us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117488.579452:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 85 00010000:00010000:2.0:1789117488.579814:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460eb0c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.579830:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460eb0c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117488.579861:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789117488.580175:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460eb05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cae7 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.580214:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460eb0c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cae7 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.580223:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:2.0:1789117488.580226:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789117488.580229:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457e800, rc 0) 00000100:00100000:2.0:1789117488.580301:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c087b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+60:11826:x1876025362442880:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 8686us (8821us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1789117488.580310:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 212 00000100:00100000:0.0:1789117488.589106:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117488.589325:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362443264 00000100:00100000:2.0:1789117488.589335:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362443264 00000100:00100000:2.0:1789117488.589433:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 16 00000100:00100000:2.0:1789117488.589444:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+60:11826:x1876025362443264:12345-192.168.206.37@tcp:103:lfs.0 00010000:00010000:2.0:1789117488.589459:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117488.589482:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460ea6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cabd expref: 60 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.589501:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:2.0:1789117488.589505:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117488.589551:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c4e520-7af6-449d-969f-b46035974613+59:11826:x1876025362443264:12345-192.168.206.37@tcp:103:lfs.0 Request processed in 109us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117488.589558:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 16 00000100:00100000:0.0:1789117488.601452:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117488.601503:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362443392 00000100:00100000:2.0:1789117488.601512:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362443392 00000100:00100000:2.0:1789117488.601562:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 213 00000100:00100000:2.0:1789117488.601583:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+59:11826:x1876025362443392:12345-192.168.206.37@tcp:58:lfs.0 00010000:00010000:2.0:1789117488.601679:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460eb1a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.601696:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460eb1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.601708:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460eb1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789117488.602845:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789117488.604079:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+59:11826:x1876025362443392:12345-192.168.206.37@tcp:58:lfs.0 Request processed in 2488us (2626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117488.604093:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 213 00000100:00100000:3.0:1789117488.612920:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117488.613226:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362443520 00000100:00100000:2.0:1789117488.613246:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362443520 00000100:00100000:2.0:1789117488.613305:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 214 00000100:00100000:2.0:1789117488.613316:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+59:11826:x1876025362443520:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:2.0:1789117488.613335:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117488.613355:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460eb21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9caee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.613431:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460eb1a lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.613442:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460eb21 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caee expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.613461:0:5841:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460eb1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.613488:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460eb21 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caee expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.613505:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:2.0:1789117488.613508:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789117488.613512:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460eb21 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caee expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.613520:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f200, rc 0) 00000100:00100000:2.0:1789117488.613580:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+60:11826:x1876025362443520:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 266us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117488.613587:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 214 00000040:00080000:3.0:1789117488.709831:0:12082:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789117488.709839:0:12082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789117488.715349:0:12082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1789117488.715363:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789117488.715526:0:12082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cc3c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12082:1876025385498624:192.168.206.37@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789117488.715635:0:12082:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f43300 going to sleep for 11 seconds 00000100:00100000:0.0:1789117488.727761:0:12082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cc3c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12082:1876025385498624:192.168.206.37@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789117488.729817:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117488.730420:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362443648 00000100:00100000:3.0:1789117488.730432:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362443648 00000100:00100000:3.0:1789117488.730491:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 215 00000100:00100000:3.0:1789117488.730502:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c05d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+60:11827:x1876025362443648:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789117488.730534:0:7242:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789117488.733214:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c05d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+60:11827:x1876025362443648:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 Request processed in 2349us (3050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117488.733235:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 215 00000100:00100000:3.0:1789117488.745131:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117488.745441:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362443776 00000100:00100000:2.0:1789117488.745451:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362443776 00000100:00100000:2.0:1789117488.745518:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 216 00000100:00100000:2.0:1789117488.745529:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+60:11827:x1876025362443776:12345-192.168.206.37@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789117488.745615:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb28 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745632:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745644:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745661:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb2f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745685:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745693:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745715:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745723:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745730:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117488.745778:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789117488.745783:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789117488.745796:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745807:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745813:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb28 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745820:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb28 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745826:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e400 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117488.745830:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb28 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745843:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb28 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745856:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1788d9e000) 00010000:00010000:2.0:1789117488.745859:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117488.745864:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb28 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745870:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb28 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745883:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745890:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb2f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745895:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745901:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457ec00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117488.745903:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745920:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb2f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745928:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9c1783e89400) 00010000:00010000:2.0:1789117488.745931:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117488.745934:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb2f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745963:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb2f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745980:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745985:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745991:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.745996:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457fa00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117488.745999:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.746005:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.746013:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:2.0:1789117488.746015:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117488.746018:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.746024:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117488.746110:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+60:11827:x1876025362443776:12345-192.168.206.37@tcp:34:lhsmtool_posix.0 Request processed in 581us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117488.746119:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 216 00000100:00100000:1.0:1789117488.754348:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117488.754499:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362444032 00000100:00100000:2.0:1789117488.754509:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362444032 00000100:00100000:2.0:1789117488.754567:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 217 00000100:00100000:2.0:1789117488.754578:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8784f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+60:11827:x1876025362444032:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117488.754608:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117488.754628:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb3d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9caf5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.754719:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.754734:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.754744:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117488.754756:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789117488.754851:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.754858:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.754864:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.754870:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457ec00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117488.754873:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.754894:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.754923:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:2.0:1789117488.754926:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789117488.754932:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.754938:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.755175:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb3d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caf5 expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.755187:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1788d9e000) 00010000:00010000:2.0:1789117488.755190:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789117488.755194:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb3d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caf5 expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.755205:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457fa00, rc 0) 00000100:00100000:2.0:1789117488.755446:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8784f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+61:11827:x1876025362444032:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 822us (1060us total) trans 4294967504 rc 301/301 00000100:00100000:2.0:1789117488.755455:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 217 00000100:00100000:0.0:1789117488.760131:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117488.760277:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362444160 00000100:00100000:2.0:1789117488.760287:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362444160 00000100:00100000:2.0:1789117488.760341:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 218 00000100:00100000:2.0:1789117488.760351:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+61:11827:x1876025362444160:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789117488.760388:0:5841:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789117488.760526:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+61:11827:x1876025362444160:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 Request processed in 176us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117488.760550:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 218 00000100:00100000:0.0:1789117488.765007:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117488.765440:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362444416 00000100:00100000:2.0:1789117488.765450:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362444416 00000100:00100000:2.0:1789117488.765506:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 219 00000100:00100000:2.0:1789117488.765516:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+61:11827:x1876025362444416:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117488.765536:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117488.765539:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789117488.765565:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eae2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cad9 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.765583:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:2.0:1789117488.765588:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117488.765600:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb52 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cafc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789117488.766006:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1789117488.767495:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.767515:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.767526:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.767578:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb52 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cafc expref: 63 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.767611:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cafc expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.767619:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c1783e89400) 00010000:00010000:2.0:1789117488.767622:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117488.767625:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457ec00, rc 0) 00000100:00100000:2.0:1789117488.767679:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+62:11827:x1876025362444416:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 2164us (2680us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1789117488.767686:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 219 00000100:00100000:1.0:1789117488.786688:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117488.787763:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362444672 00000100:00100000:2.0:1789117488.787774:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362444672 00000100:00100000:2.0:1789117488.787837:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 220 00000100:00100000:2.0:1789117488.787848:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8786940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+62:11827:x1876025362444672:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789117488.787905:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117488.787943:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460eb59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cafc expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.787971:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c1783e89400) 00010000:00010000:2.0:1789117488.787982:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789117488.788000:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb67 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.788013:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.788023:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.788057:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eb6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x8fa3d4fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.788065:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eb6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8fa3d4fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.788071:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eb6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8fa3d4fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.788139:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.788146:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb67 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.788151:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb67 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.788157:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457fa00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117488.788161:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb67 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.788168:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb67 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.788176:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:2.0:1789117488.788178:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117488.788182:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb67 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.788188:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460eb67 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.788206:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eb6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8fa3d4fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.788212:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eb6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8fa3d4fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.788218:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eb6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8fa3d4fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.788459:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117488.788463:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eb6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8fa3d4fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.788471:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eb6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8fa3d4fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.788478:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x8fa3d4fa (ffff9c1783e89300) 00010000:00010000:2.0:1789117488.788481:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117488.788484:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eb6e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8fa3d4fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.788489:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eb6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8fa3d4fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117488.788565:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8786940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+61:11827:x1876025362444672:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 Request processed in 718us (1884us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789117488.788573:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 220 00000100:00100000:0.0:1789117488.794683:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117488.794756:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362444800 00000100:00100000:3.0:1789117488.794765:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362444800 00000100:00100000:3.0:1789117488.794822:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 221 00000100:00100000:3.0:1789117488.794832:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+61:11827:x1876025362444800:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789117488.794860:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117488.794888:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460eb75 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cb03 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.794934:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460eb7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.794947:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460eb7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.794969:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460eb7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.795338:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460eb75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb03 expref: 63 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.795366:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460eb7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb03 expref: 62 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.795373:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c1782df4d00) 00010000:00010000:3.0:1789117488.795376:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789117488.795379:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685600, rc 0) 00000100:00100000:3.0:1789117488.795471:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+62:11827:x1876025362444800:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 640us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117488.795478:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 221 00000100:00100000:0.0:1789117488.799001:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117488.799131:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362445056 00000100:00100000:2.0:1789117488.799140:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362445056 00000100:00100000:2.0:1789117488.799189:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 222 00000100:00100000:2.0:1789117488.799212:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+62:11827:x1876025362445056:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789117488.799297:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.799312:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.799323:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789117488.799581:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1789117488.799591:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335929190127ns, next at 336929187538ns, rc = 0 00000004:00010000:2.0:1789117488.799672:0:5841:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b6833858 reply state 00000000d2309f19 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117488.799682:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789117488.799758:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+64:11827:x1876025362445056:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 Request processed in 547us (764us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789117488.799765:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 222 00010000:00010000:3.0:1789117488.804125:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.804142:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.804149:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.804155:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e400 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117488.804160:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.804167:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.804184:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c1782df4d00) 00010000:00010000:3.0:1789117488.804187:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789117488.804191:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.804212:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e400/0xf7565228e460eb83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117488.805248:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117488.805640:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362445184 00000100:00100000:2.0:1789117488.805649:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362445184 00000100:00100000:2.0:1789117488.805700:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 223 00000100:00100000:2.0:1789117488.805710:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+63:11827:x1876025362445184:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117488.805732:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117488.805749:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eb8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cb0a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.805803:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eb8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb0a expref: 64 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.805828:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eb8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb0a expref: 64 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.805848:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c1782df4d00) 00010000:00010000:2.0:1789117488.805851:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789117488.805854:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f600, rc 0) 00000100:00100000:2.0:1789117488.807942:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+64:11827:x1876025362445184:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 2224us (2691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117488.807954:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 223 00000100:00100000:0.0:1789117488.811528:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117488.811603:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362445312 00000100:00100000:3.0:1789117488.811613:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362445312 00000100:00100000:3.0:1789117488.811785:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 62 00000100:00100000:3.0:1789117488.811795:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+9:2350:x1876025362445312:12345-192.168.206.37@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789117488.812165:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+10:2350:x1876025362445312:12345-192.168.206.37@tcp:2:lhsmtool_posix.0 Request processed in 370us (644us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1789117488.812174:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 62 00000100:00100000:0.0:1789117488.818019:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117488.818319:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362445568 00000100:00100000:1.0:1789117488.818329:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362445568 00000100:00100000:1.0:1789117488.818378:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 60 00000100:00100000:1.0:1789117488.818387:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+64:11827:x1876025362445568:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789117488.818616:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+65:11827:x1876025362445568:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 Request processed in 229us (605us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789117488.818623:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 60 00000100:00100000:1.0:1789117488.825952:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117488.826173:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362445824 00000100:00100000:2.0:1789117488.826183:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362445824 00000100:00100000:2.0:1789117488.826249:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 224 00000100:00100000:2.0:1789117488.826259:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8786d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+65:11827:x1876025362445824:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789117488.826375:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8786d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+65:11827:x1876025362445824:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 Request processed in 117us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117488.826384:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 224 00000100:00100000:0.0:1789117488.829724:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117488.829804:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362445952 00000100:00100000:3.0:1789117488.829812:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362445952 00000100:00100000:3.0:1789117488.829878:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 225 00000100:00100000:3.0:1789117488.829887:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+65:11827:x1876025362445952:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789117488.829905:0:7242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117488.829934:0:7242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460eb91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cb11 expref: -99 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.830002:0:7242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eb98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.830016:0:7242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eb98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.830026:0:7242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eb98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117488.830074:0:7242:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789117488.830108:0:7242:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eb98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.830133:0:7242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781684c00/0xf7565228e460eb91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb11 expref: 67 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.830151:0:7242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eb98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb11 expref: 66 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.830161:0:7242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c1782df4d00) 00010000:00010000:3.0:1789117488.830165:0:7242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789117488.830168:0:7242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781685400, rc 0) 00000100:00100000:3.0:1789117488.830237:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+66:11827:x1876025362445952:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 351us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117488.830245:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 225 00000100:00100000:0.0:1789117488.835502:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117488.835705:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362446080 00000100:00100000:2.0:1789117488.835714:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362446080 00000100:00100000:2.0:1789117488.835777:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 63 00000100:00100000:2.0:1789117488.835788:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+10:2351:x1876025362446080:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117488.835808:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117488.835832:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363c6d1f/0xf7565228e460eb9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cb18 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789117488.835861:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3c42f, blocks: 0x1 00010000:00010000:2.0:1789117488.835893:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=335s v=(0 0) 00010000:00010000:2.0:1789117488.835898:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117488.835919:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363c6d1f/0xf7565228e460eb9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb18 expref: 11 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.835937:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363c6d1f/0xf7565228e460eb9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb18 expref: 11 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.835951:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457fa00, rc 0) 00000100:00100000:2.0:1789117488.836012:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+11:2351:x1876025362446080:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 225us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117488.836020:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 63 00000100:00100000:1.0:1789117488.847558:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117488.848020:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362446336 00000100:00100000:2.0:1789117488.848030:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362446336 00000100:00100000:2.0:1789117488.848100:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 226 00000100:00100000:2.0:1789117488.848111:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8784780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+66:11827:x1876025362446336:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789117488.848214:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8784780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+66:11827:x1876025362446336:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 Request processed in 104us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117488.848922:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 226 00000100:00100000:0.0:1789117488.851185:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117488.851311:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362446464 00000100:00100000:3.0:1789117488.851321:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362446464 00000100:00100000:3.0:1789117488.851376:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 64 00000100:00100000:3.0:1789117488.851387:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+11:11827:x1876025362446464:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789117488.851440:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117488.851459:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460eba6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cb1f expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.851489:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363c6d1f/0xf7565228e460eb9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb18 expref: 12 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.851498:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117488.851503:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117488.851521:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460eba6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb1f expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.851554:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000363c6d1f/0xf7565228e460eb9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb18 expref: 12 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.851569:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000363c6d1f/0xf7565228e460eb9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb18 expref: 12 pid: 6685 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117488.851583:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ccf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1876025385498752:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117488.851658:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f43240 going to sleep for 11 seconds 00000100:00100000:3.0:1789117488.855677:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ccf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1876025385498752:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117488.855719:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460eba6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb1f expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.855740:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1781684c00, rc 0) 00000100:00100000:3.0:1789117488.855800:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+12:11827:x1876025362446464:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 4414us (4622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117488.855809:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 64 00000100:00100000:1.0:1789117488.857012:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117488.857143:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362446592 00000100:00100000:3.0:1789117488.857151:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362446592 00010000:00010000:3.0:1789117488.857187:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000363c6d1f/0xf7565228e460eb9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb18 expref: 12 pid: 6685 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117488.862117:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 86 00000100:00100000:3.0:1789117488.862145:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8785a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+12:2350:x1876025362446592:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117488.862177:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117488.862206:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000363c6d1f/0xf7565228e460eb9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb18 expref: 12 pid: 6685 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.862305:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000363c6d1f/0xf7565228e460eb9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb18 expref: 12 pid: 6685 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.862331:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363c6d1f/0xf7565228e460eb9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb18 expref: 12 pid: 6685 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.862348:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117488.862352:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117488.862359:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460eba6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb1f expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.862370:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460eba6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb1f expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.862437:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460eba6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb1f expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117488.862451:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ccf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5825:1876025385498880:192.168.206.37@tcp:105: 00000100:00100000:3.0:1789117488.862546:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f43240 going to sleep for 11 seconds 00000100:00100000:0.0:1789117488.869275:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117488.869825:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362446720 00000100:00100000:1.0:1789117488.869835:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362446720 00002000:00100000:1.0:1789117488.869899:0:6691:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9c1681ef03c0 x1876025362446720/t0(0) o4->e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp:39/0 lens 504/0 e 0 to 0 dl 1789117499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117488.869922:0:6691:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1681ef03c0 with x1876025362446720 ext(0->12) 00002000:00010000:1.0:1789117488.869929:0:6691:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c1681ef03c0 00000100:00100000:1.0:1789117488.869964:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 6 00000100:00100000:1.0:1789117488.869975:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e0c4e520-7af6-449d-969f-b46035974613+12:2349:x1876025362446720:12345-192.168.206.37@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789117488.870608:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e0c4e520-7af6-449d-969f-b46035974613+14:2349:x1876025362446720:12345-192.168.206.37@tcp:4:lhsmtool_posix.0 Request processed in 632us (1338us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1789117488.870617:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 6 00002000:00100000:1.0:1789117488.870625:0:6691:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9c1681ef03c0 x1876025362446720/t4294967320(0) o4->e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp:39/0 lens 504/448 e 0 to 0 dl 1789117499 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789117488.870634:0:6691:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1681ef03c0 with x1876025362446720 ext(0->12) 00002000:00010000:1.0:1789117488.870638:0:6691:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c1681ef03c0 00000100:00100000:3.0:1789117488.872965:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ccf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5825:1876025385498880:192.168.206.37@tcp:105: 00010000:00010000:3.0:1789117488.872993:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117488.873087:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8785a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c4e520-7af6-449d-969f-b46035974613+13:2350:x1876025362446592:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 10955us (16080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117488.873097:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 86 00000100:00100000:0.0:1789117488.874103:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117488.874243:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362446848 00000100:00100000:3.0:1789117488.874251:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362446848 00000100:00100000:3.0:1789117488.874303:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 227 00000100:00100000:3.0:1789117488.874312:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+66:11827:x1876025362446848:12345-192.168.206.37@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789117488.938973:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+66:11827:x1876025362446848:12345-192.168.206.37@tcp:44:lhsmtool_posix.0 Request processed in 64645us (64857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117488.938990:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 227 00000001:00080000:1.0:1789117488.945442:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000001:00080000:1.0:1789117488.945475:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:1.0:1789117488.945486:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:1.0:1789117488.945509:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1789117488.945533:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c17852d1900 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789117488.945538:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1788cb0b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c17852d1b40 00000020:00080000:1.0:1789117488.945542:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1788cb0c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c17c0041c00 00000004:00080000:1.0:1789117488.945572:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789117488.945588:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c17852d1780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1789117488.945592:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1788cb0700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c17852d1240 00000020:00080000:1.0:1789117488.945595:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1788cb0800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c17c0250800 00000100:00100000:2.0:1789117488.945667:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000020:00080000:3.0:1789117488.945765:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:1.0:1789117488.945953:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362446976 00000100:00100000:1.0:1789117488.945962:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362446976 00000020:00080000:3.0:1789117488.945982:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789117488.946023:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 65 00000100:00100000:1.0:1789117488.946035:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0254b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+13:2350:x1876025362446976:12345-192.168.206.37@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789117488.947281:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681ef0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385499008:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789117488.947370:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117488.947467:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789117488.947475:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681ef2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385499136:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789117488.947569:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117488.947686:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789117488.947697:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681ef2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385499264:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789117488.947726:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117488.948266:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385499008 00000100:00100000:3.0:1789117488.948276:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385499008 00000100:00100000:3.0:1789117488.948322:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385499136 00000100:00100000:3.0:1789117488.948325:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385499136 00000100:00100000:3.0:1789117488.948337:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385499264 00000100:00100000:3.0:1789117488.948340:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385499264 00000100:00100000:3.0:1789117488.948357:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789117488.948372:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c013d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3298:x1876025385499008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789117488.948429:0:6687:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1789117488.948466:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4c395bc/0xf7565228e460ebad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.948492:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004d1ea30f/0xf7565228e460e96f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca7e expref: 13 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.948502:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789117488.948521:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789117488.948526:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4c395bc/0xf7565228e460ebad lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.948946:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004d1ea30f/0xf7565228e460e96f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca7e expref: 13 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.948985:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004d1ea30f/0xf7565228e460e96f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca7e expref: 13 pid: 8269 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117488.949002:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ccf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1876025385499392:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117488.949097:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f43240 going to sleep for 11 seconds 00000100:00100000:3.0:1789117488.954923:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ccf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1876025385499392:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117488.954968:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4c395bc/0xf7565228e460ebad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117488.957715:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117488.957749:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362447104 00000100:00100000:2.0:1789117488.957758:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362447104 00010000:00010000:2.0:1789117488.957802:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004d1ea30f/0xf7565228e460e96f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca7e expref: 14 pid: 8269 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117488.957844:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 87 00000100:00100000:2.0:1789117488.957854:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+14:2350:x1876025362447104:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117488.957870:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117488.957878:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004d1ea30f/0xf7565228e460e96f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca7e expref: 14 pid: 8269 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.957894:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004d1ea30f/0xf7565228e460e96f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca7e expref: 14 pid: 8269 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.957932:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d1ea30f/0xf7565228e460e96f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca7e expref: 14 pid: 8269 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.957949:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789117488.957953:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789117488.957959:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4c395bc/0xf7565228e460ebad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.957968:0:7638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4c395bc/0xf7565228e460ebad lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.958001:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117488.958050:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+13:2350:x1876025362447104:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 197us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117488.958070:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 87 00010000:00010000:3.0:1789117488.958090:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4c395bc/0xf7565228e460ebad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.958110:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4c395bc/0xf7565228e460ebad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.958125:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4c395bc/0xf7565228e460ebad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.958135:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4c395bc/0xf7565228e460ebad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.958185:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117488.958198:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117488.958207:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4c395bc/0xf7565228e460ebad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.958216:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2045000 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117488.958220:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4c395bc/0xf7565228e460ebad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.958230:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4c395bc/0xf7565228e460ebad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.958243:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4c395bc/0xf7565228e460ebad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.958250:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4c395bc/0xf7565228e460ebad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117488.958272:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117488.958274:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117488.958276:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117488.962277:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c013d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3298:x1876025385499008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13892us (14891us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1789117488.962295:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789117488.962491:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789117488.962508:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3298:x1876025385499136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789117488.962717:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789117488.962722:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789117488 00002000:00010000:3.0:1789117488.962724:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789117488.962726:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789117487 -> 1789117488 00002000:00010000:3.0:1789117488.962729:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789117488.962772:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3298:x1876025385499136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 269us (15201us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789117488.962780:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789117488.962803:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789117488.962814:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3301:x1876025385499264:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1789117488.962825:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c1681ef2940/2, rc 0, transno 4294967322 00002000:00080000:3.0:1789117488.962834:0:6687:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00000100:00100000:1.0:1789117488.962842:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681ef2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385499136:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1789117488.962859:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c1681ef0f00/2, rc 0, transno 4294967321 00000100:00100000:1.0:1789117488.962864:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681ef0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385499008:0@lo:6:osp-syn-0-0.0 00002000:00010000:3.0:1789117488.962872:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3c42e, atime: 0x6aa3c42f, ctime: 0x6aa3c42e, blocks: 0x1 00010000:00010000:3.0:1789117488.962885:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5f15293/0xf7565228e460ebb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.962904:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=336s v=(0 0) 00010000:00010000:3.0:1789117488.962922:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117488.962931:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5f15293/0xf7565228e460ebb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.963089:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5f15293/0xf7565228e460ebb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.963102:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5f15293/0xf7565228e460ebb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.963111:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5f15293/0xf7565228e460ebb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117488.963148:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789117488.964159:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117488.964172:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5f15293/0xf7565228e460ebb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.964185:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2045600 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:1.0:1789117488.964190:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5f15293/0xf7565228e460ebb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.964210:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5f15293/0xf7565228e460ebb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.964243:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5f15293/0xf7565228e460ebb4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.964261:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5f15293/0xf7565228e460ebb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117488.964287:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117488.964289:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117488.964291:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117488.965488:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117488.968886:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3301:x1876025385499264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6065us (21149us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789117488.968902:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:0.0:1789117488.974092:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c1681ef2d00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789117488.974104:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681ef2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385499264:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1789117489.007386:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:2.0:1789117489.007435:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1789117489.007445:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000100:00100000:1.0:1789117489.007794:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0254b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+7:2350:x1876025362446976:12345-192.168.206.37@tcp:16:lhsmtool_posix.0 Request processed in 61757us (62127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117489.007805:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 65 00000100:00100000:2.0:1789117489.011083:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117489.011184:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362447360 00000100:00100000:3.0:1789117489.011194:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362447360 00000100:00100000:3.0:1789117489.011348:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 228 00000100:00100000:3.0:1789117489.011359:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0256580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+20:11827:x1876025362447360:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789117489.011453:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117489.011478:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685400/0xf7565228e460eb98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb11 expref: 20 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.011497:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c1782df4d00) 00010000:00010000:3.0:1789117489.011502:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789117489.011530:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.011563:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.011574:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789117489.011803:0:5839:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000025d02d1b reply state 00000000f4759746 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117489.011812:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789117489.011927:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0256580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+21:11827:x1876025362447360:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 Request processed in 570us (853us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789117489.011935:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 228 00000100:00100000:0.0:1789117489.014789:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117489.014928:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362447488 00000100:00100000:2.0:1789117489.014937:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362447488 00000100:00100000:2.0:1789117489.015012:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 69 00000100:00100000:2.0:1789117489.015022:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+7:2349:x1876025362447488:12345-192.168.206.37@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789117489.015207:0:8269:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789117489.015211:0:8269:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789117488 -> 1789117487 00002000:00010000:2.0:1789117489.015213:0:8269:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789117487 00002000:00010000:2.0:1789117489.015215:0:8269:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789117488 -> 1789117487 00002000:00010000:2.0:1789117489.015218:0:8269:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789117489.015285:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+8:2349:x1876025362447488:12345-192.168.206.37@tcp:2:lhsmtool_posix.0 Request processed in 264us (503us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1789117489.015293:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 69 00000100:00080000:0.0:1789117489.015963:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789117489.016149:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117489.016162:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebbb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117489.016170:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117489.016177:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2044200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117489.016182:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117489.016205:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebbb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117489.016233:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c1782df4d00) 00010000:00010000:1.0:1789117489.016236:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117489.016242:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebbb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117489.016249:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebbb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117489.021828:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117489.021983:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362447744 00000100:00100000:2.0:1789117489.021993:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362447744 00000100:00100000:2.0:1789117489.022049:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 229 00000100:00100000:2.0:1789117489.022059:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+20:11827:x1876025362447744:12345-192.168.206.37@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789117489.022121:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460ebc2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.022138:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460eb7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb03 expref: 20 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.022149:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460ebc2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.022181:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460eb7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb03 expref: 20 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.022195:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460eb7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb03 expref: 20 pid: 7242 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117489.022235:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0255680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876025385499520:192.168.206.37@tcp:104: 00000100:00100000:2.0:1789117489.022318:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681f1d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789117489.025244:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117489.025331:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362447872 00000100:00100000:1.0:1789117489.025340:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362447872 00010000:00010000:1.0:1789117489.025376:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460eb7c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb03 expref: 21 pid: 7242 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117489.025445:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 88 00000100:00100000:1.0:1789117489.025455:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0254f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+21:2349:x1876025362447872:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117489.025468:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117489.025475:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460eb7c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb03 expref: 21 pid: 7242 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117489.025487:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460eb7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb03 expref: 21 pid: 7242 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117489.025507:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c1782df4d00) 00010000:00010000:1.0:1789117489.025512:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460ebc2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117489.025538:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460ebc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117489.025546:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460ebc2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117489.025562:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117489.025602:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0254f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+21:2349:x1876025362447872:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 149us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117489.025610:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 88 00010000:00010000:0.0:1789117489.026487:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685600/0xf7565228e460eb7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb03 expref: 20 pid: 7242 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117489.026511:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0255680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876025385499520:192.168.206.37@tcp:104: 00010000:00010000:0.0:1789117489.026531:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460ebc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.026540:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460ebc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.026546:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460ebc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.026572:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460ebc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.026579:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460ebc2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.026585:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460ebc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.026591:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457ec00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117489.026595:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460ebc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.026603:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460ebc2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.026612:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c1782df4d00) 00010000:00010000:0.0:1789117489.026615:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789117489.026619:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460ebc2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.026630:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460ebc2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117489.026684:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+19:11827:x1876025362447744:12345-192.168.206.37@tcp:55:lhsmtool_posix.0 Request processed in 4626us (4864us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789117489.026692:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 229 00000100:00100000:2.0:1789117489.028932:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117489.028999:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362448000 00000100:00100000:3.0:1789117489.029006:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362448000 00000100:00100000:3.0:1789117489.029052:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 70 00000100:00100000:3.0:1789117489.029063:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0256940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+8:2350:x1876025362448000:12345-192.168.206.37@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789117489.029104:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d433f5db/0xf7565228e460ebc9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.029123:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460eba6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb1f expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.029131:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789117489.029136:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789117489.029141:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d433f5db/0xf7565228e460ebc9 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.029186:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460eba6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb1f expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.029199:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460eba6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb1f expref: 8 pid: 6687 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117489.029212:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ccf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1876025385499648:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117489.029289:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f43b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789117489.035742:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ccf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1876025385499648:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117489.035770:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d433f5db/0xf7565228e460ebc9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117489.037537:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117489.037696:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362448128 00000100:00100000:3.0:1789117489.037704:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362448128 00010000:00010000:3.0:1789117489.037743:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460eba6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb1f expref: 9 pid: 6687 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117489.037794:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 89 00000100:00100000:3.0:1789117489.037804:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0256d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+9:2349:x1876025362448128:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117489.037818:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117489.037841:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460eba6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb1f expref: 9 pid: 6687 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.037854:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460eba6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb1f expref: 9 pid: 6687 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.037902:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b65b36ee/0xf7565228e460eba6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb1f expref: 9 pid: 6687 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.037929:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789117489.037934:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789117489.037940:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d433f5db/0xf7565228e460ebc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.037950:0:7638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d433f5db/0xf7565228e460ebc9 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.037984:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117489.038041:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0256d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+8:2349:x1876025362448128:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 238us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117489.038050:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 89 00010000:00010000:0.0:1789117489.038111:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d433f5db/0xf7565228e460ebc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.038121:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d433f5db/0xf7565228e460ebc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.038145:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d433f5db/0xf7565228e460ebc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.038152:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d433f5db/0xf7565228e460ebc9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.038160:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d433f5db/0xf7565228e460ebc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.038167:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2044200 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:0.0:1789117489.038171:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d433f5db/0xf7565228e460ebc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.038179:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d433f5db/0xf7565228e460ebc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.038201:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d433f5db/0xf7565228e460ebc9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.038208:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d433f5db/0xf7565228e460ebc9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117489.038259:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0256940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+7:2350:x1876025362448000:12345-192.168.206.37@tcp:1:lhsmtool_posix.0 Request processed in 9198us (9334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117489.038266:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 70 00000100:00100000:1.0:1789117489.041579:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117489.041669:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362448384 00000100:00100000:2.0:1789117489.041677:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362448384 00000100:00100000:2.0:1789117489.041733:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 230 00000100:00100000:2.0:1789117489.041742:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8785e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+19:11827:x1876025362448384:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789117489.041824:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460ebd0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.041840:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460ebd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.041851:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460ebd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.042070:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ebd7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.042082:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eb8a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb0a expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.042090:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ebd7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.042121:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eb8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb0a expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.042148:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eb8a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb0a expref: 20 pid: 5840 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117489.042162:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0254780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876025385499776:192.168.206.37@tcp:104: 00000100:00100000:2.0:1789117489.042249:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681f1d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789117489.045036:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117489.045106:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362448512 00000100:00100000:0.0:1789117489.045114:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362448512 00010000:00010000:0.0:1789117489.045150:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eb8a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb0a expref: 21 pid: 5840 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117489.045189:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 90 00000100:00100000:0.0:1789117489.045199:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+21:2352:x1876025362448512:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117489.045213:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117489.045230:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eb8a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb0a expref: 21 pid: 5840 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.045244:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eb8a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb0a expref: 21 pid: 5840 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.045266:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c1782df4d00) 00010000:00010000:0.0:1789117489.045272:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ebd7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.045294:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ebd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.045302:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ebd7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.045335:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117489.045389:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+21:2352:x1876025362448512:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 191us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117489.045396:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 90 00010000:00010000:2.0:1789117489.047021:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460eb8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb0a expref: 20 pid: 5840 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117489.047043:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0254780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876025385499776:192.168.206.37@tcp:104: 00010000:00010000:2.0:1789117489.047065:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ebd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.047074:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ebd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.047080:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ebd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789117489.047273:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1789117489.047645:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1789117489.047696:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1789117489.048017:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0254780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5841:1876025385499904:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789117489.048094:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117489.048124:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681f1d540 going to sleep for 11 seconds 00000100:00100000:0.0:1789117489.049063:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385499904 00000100:00100000:0.0:1789117489.049073:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385499904 00000100:00100000:0.0:1789117489.049145:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789117489.049155:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0255a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5841:x1876025385499904:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789117489.049276:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0255a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5841:x1876025385499904:12345-0@lo:1000:mdt00_002.0 Request processed in 122us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117489.049284:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789117489.049370:0:5841:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:3.0:1789117489.049377:0:5841:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:3.0:1789117489.049434:0:5841:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9c1681ef0f00 x1876025385499008/t4294967321(4294967321) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789117504 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117489.049447:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0254780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5841:1876025385499904:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789117489.050150:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1789117489.050219:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ccf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5841:1876025385500032:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789117489.050261:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117489.050280:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f43f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117489.050548:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385500032 00000100:00100000:0.0:1789117489.050554:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385500032 00000100:00100000:0.0:1789117489.050584:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789117489.050592:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5841:x1876025385500032:12345-0@lo:1000:mdt00_002.0 00000100:00080000:1.0:1789117489.050976:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117489.051502:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5841:x1876025385500032:12345-0@lo:1000:mdt00_002.0 Request processed in 909us (1239us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789117489.051511:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789117489.055715:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ccf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5841:1876025385500032:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789117489.056610:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ebd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.056623:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ebd7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.056639:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ebd7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.056646:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117489.056650:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ebd7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.056657:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ebd7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.056672:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c1782df4d00) 00010000:00010000:0.0:1789117489.056675:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789117489.056679:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ebd7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.056685:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e600/0xf7565228e460ebd7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.056715:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460eb1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.056721:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460eb1a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.056727:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460eb1a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.056732:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117489.056735:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460eb1a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.056752:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460eb1a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.056771:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:0.0:1789117489.056774:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789117489.056782:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460eb21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caee expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.056793:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460eb21 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caee expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.056801:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460eb21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caee expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.056839:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460eb21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caee expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117489.056853:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681ef0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876025385500160:192.168.206.37@tcp:105: 00000100:00100000:0.0:1789117489.057038:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b87e2840 going to sleep for 11 seconds 00000100:00100000:1.0:1789117489.067715:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117489.067898:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681ef0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876025385500160:192.168.206.37@tcp:105: 00010000:00010000:2.0:1789117489.067937:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460eb1a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.067959:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460eb1a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.067987:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ebde lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.068001:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ebde lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.068013:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ebde lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.068025:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ebde lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.068032:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ebde lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.068039:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ebde lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.068044:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117489.068048:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ebde lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.068056:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ebde lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.068069:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:2.0:1789117489.068072:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117489.068076:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ebde lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.068090:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ebde lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.068102:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460ebd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.068109:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460ebd0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.068114:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460ebd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.068120:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457fa00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117489.068123:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460ebd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.068129:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460ebd0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.068137:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:2.0:1789117489.068140:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789117489.068143:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460ebd0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117489.068148:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460ebd0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117489.068642:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8785e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+23:11827:x1876025362448384:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 Request processed in 26898us (27069us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1789117489.068653:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 230 00000020:00080000:2.0:1789117489.068665:0:5841:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789117489.070144:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362448640 00000100:00100000:0.0:1789117489.070157:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362448640 00000100:00100000:0.0:1789117489.070221:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 61 00000100:00100000:0.0:1789117489.070231:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+23:11826:x1876025362448640:12345-192.168.206.37@tcp:49:lfs.0 00000100:00100000:0.0:1789117489.070356:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+23:11826:x1876025362448640:12345-192.168.206.37@tcp:49:lfs.0 Request processed in 126us (2649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117489.070364:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 61 00000040:00080000:3.0:1789117489.075386:0:12082:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789117489.075394:0:12082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789117489.076115:0:12082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789117489.076126:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789117489.080614:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117489.080685:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117489.081310:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362449152 00000100:00100000:3.0:1789117489.081321:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362449152 00000100:00100000:3.0:1789117489.081381:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 231 00000100:00100000:3.0:1789117489.081391:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+23:11826:x1876025362449152:12345-192.168.206.37@tcp:58:lfs.0 00000040:00080000:3.0:1789117489.081752:0:7242:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789117489.081868:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+23:11826:x1876025362449152:12345-192.168.206.37@tcp:58:lfs.0 Request processed in 470us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117489.081876:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 231 00000100:00100000:0.0:1789117489.084874:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362448896 00000100:00100000:0.0:1789117489.084887:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362448896 00000100:00100000:0.0:1789117489.084965:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 62 00000100:00100000:0.0:1789117489.084974:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a9732850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+23:11827:x1876025362448896:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789117489.085665:0:5843:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789117489.085779:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:0.0:1789117489.085832:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ebe5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.085847:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ebe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.085857:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ebe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.085866:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ebe5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.085873:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ebe5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.085879:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ebe5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.085904:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789117489.086002:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a9732850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+25:11827:x1876025362448896:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 Request processed in 1027us (5396us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1789117489.086010:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 62 00000020:00080000:0.0:1789117489.086015:0:5843:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789117489.086579:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117489.086587:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ebe5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117489.086596:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd000 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:1.0:1789117489.086599:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ebe5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117489.086607:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ebe5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117489.086620:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c1782c0ef00) 00010000:00010000:1.0:1789117489.086623:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789117489.086637:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ebe5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117489.086643:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460ebe5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117489.086660:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117489.086662:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117489.086664:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117489.138617:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117489.138741:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362449280 00000100:00100000:3.0:1789117489.138751:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362449280 00000100:00100000:3.0:1789117489.138823:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 232 00000100:00100000:3.0:1789117489.138834:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8787840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+25:11829:x1876025362449280:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:3.0:1789117489.138857:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117489.138890:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460ebec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cb26 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.138969:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ebf3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.138985:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ebf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.138996:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ebf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.139031:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.139039:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.139046:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.139345:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7200/0xf7565228e460ec01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.139357:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460eb0c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cae7 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.139366:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7200/0xf7565228e460ec01 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.139441:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460eb0c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cae7 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.139456:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460eb0c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cae7 expref: 26 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117489.139469:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ced00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876025385500288:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117489.139559:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f43300 going to sleep for 11 seconds 00000100:00100000:2.0:1789117489.146255:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117489.147109:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362449536 00000100:00100000:0.0:1789117489.147122:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362449536 00000100:00100000:0.0:1789117489.147213:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 63 00000100:00100000:0.0:1789117489.147225:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0255e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+27:5603:x1876025362449536:12345-192.168.206.37@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789117489.147548:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0255e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+28:5603:x1876025362449536:12345-192.168.206.37@tcp:35:ldlm_bl.0 Request processed in 325us (1302us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1789117489.147557:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 63 00000100:00100000:3.0:1789117489.148177:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ced00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876025385500288:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117489.148202:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7200/0xf7565228e460ec01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117489.153501:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117489.153587:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362449664 00000100:00100000:3.0:1789117489.153595:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362449664 00010000:00010000:3.0:1789117489.153633:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460eb0c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cae7 expref: 28 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117489.153674:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 91 00000100:00100000:3.0:1789117489.153684:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8786580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+28:2349:x1876025362449664:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117489.153699:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117489.153705:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460eb0c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cae7 expref: 28 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.153718:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460eb0c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cae7 expref: 28 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.153740:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460eb0c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cae7 expref: 28 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.153756:0:7638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:3.0:1789117489.153761:0:7638:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7200/0xf7565228e460ec01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.153771:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7200/0xf7565228e460ec01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.153779:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7200/0xf7565228e460ec01 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117489.153805:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117489.154033:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8786580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c4e520-7af6-449d-969f-b46035974613+27:2349:x1876025362449664:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 350us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117489.154041:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 91 00010000:00010000:0.0:1789117489.154261:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7200/0xf7565228e460ec01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.154271:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7200/0xf7565228e460ec01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117489.154315:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789117489.154320:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789117489.154338:0:5839:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7200/0xf7565228e460ec01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.154350:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7200/0xf7565228e460ec01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.154359:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ebf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.154366:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ebf3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.154372:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ebf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.154379:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2045000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117489.154383:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ebf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.154443:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ebf3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.154452:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:0.0:1789117489.154455:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117489.154459:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ebf3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.154465:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460ebf3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.154478:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.154484:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebfa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.154490:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.154495:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2044200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117489.154498:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.154504:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.154511:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c1782df4300) 00010000:00010000:0.0:1789117489.154513:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117489.154516:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebfa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.154531:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460ebfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.154566:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460ebec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb26 expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.154580:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7200/0xf7565228e460ec01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb26 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117489.154587:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:0.0:1789117489.154590:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789117489.154592:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c16829c7200, rc 0) 00000100:00100000:0.0:1789117489.154623:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8787840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0c4e520-7af6-449d-969f-b46035974613+26:11829:x1876025362449280:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 15791us (16014us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117489.154630:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 232 00000001:00080000:3.0:1789117489.288207:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1789117489.288236:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1789117489.288245:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1789117489.288251:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000040:00080000:0.0:1789117489.695119:0:12960:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789117489.695127:0:12960:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789117489.695165:0:12960:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789117489.695170:0:12960:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789117489.990556:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789117490.117787:0:12082:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789117490.117795:0:12082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789117490.117832:0:12082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789117490.117839:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789117490.117975:0:12082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ced00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12082:1876025385500416:192.168.206.37@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789117490.118075:0:12082:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b7f430c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117490.122937:0:12082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ced00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12082:1876025385500416:192.168.206.37@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789117490.124752:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117490.125097:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362449792 00000100:00100000:3.0:1789117490.125105:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362449792 00000100:00100000:3.0:1789117490.125178:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 233 00000100:00100000:3.0:1789117490.125189:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+26:11842:x1876025362449792:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789117490.125234:0:7242:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789117490.125638:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+26:11842:x1876025362449792:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 Request processed in 449us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117490.125647:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 233 00000100:00080000:1.0:1789117490.125750:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117490.128952:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117490.129050:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362450048 00000100:00100000:2.0:1789117490.129059:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362450048 00000100:00100000:2.0:1789117490.129117:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 234 00000100:00100000:2.0:1789117490.129126:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8785680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+26:11842:x1876025362450048:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117490.129145:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117490.129165:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460ec08 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cb2d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117490.129276:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ec0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117490.129290:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ec0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117490.129301:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ec0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117490.129312:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789117490.129457:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f800/0xf7565228e460ec08 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb2d expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117490.129473:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ec0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb2d expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117490.129495:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:2.0:1789117490.129498:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117490.129501:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f600, rc 0) 00000100:00100000:2.0:1789117490.129559:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8785680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+28:11842:x1876025362450048:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 434us (616us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789117490.129577:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 234 00000100:00100000:0.0:1789117490.136271:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117490.136367:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117490.136532:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362450432 00000100:00100000:2.0:1789117490.136541:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362450432 00000100:00100000:2.0:1789117490.136600:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 235 00000100:00100000:2.0:1789117490.136610:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+28:11842:x1876025362450432:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789117490.136683:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460ec1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117490.136700:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460ec1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117490.136712:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460ec1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117490.136893:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460ec1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117490.136911:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460ec1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117490.136917:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460ec1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117490.136924:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117490.136928:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460ec1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117490.136935:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460ec1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117490.136963:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:2.0:1789117490.136966:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789117490.136971:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460ec1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117490.136978:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460ec1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117490.137107:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362450176 00000100:00100000:1.0:1789117490.137113:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362450176 00000100:00100000:2.0:1789117490.137125:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+30:11842:x1876025362450432:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 Request processed in 515us (755us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1789117490.137135:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 235 00000100:00100000:1.0:1789117490.137153:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 17 00000100:00100000:1.0:1789117490.137168:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+29:2349:x1876025362450176:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117490.137179:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117490.137194:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460ec0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb2d expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117490.137207:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:1.0:1789117490.137210:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117490.137232:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c4e520-7af6-449d-969f-b46035974613+28:2349:x1876025362450176:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 71us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117490.137239:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 17 00000040:00080000:0.0:1789117490.137476:0:12082:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789117490.137481:0:12082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789117490.137983:0:12082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789117490.137991:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789117490.142363:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117490.142454:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362450688 00000100:00100000:0.0:1789117490.142476:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362450688 00000100:00100000:0.0:1789117490.142587:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 64 00000100:00100000:0.0:1789117490.142598:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8787c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+28:11842:x1876025362450688:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789117490.142816:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8787c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+29:11842:x1876025362450688:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 Request processed in 220us (462us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1789117490.142824:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 64 00010000:00010000:3.0:1789117491.020423:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789117491.422609:0:13011:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789117491.422622:0:13011:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789117491.422669:0:13011:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789117491.422675:0:13011:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789117491.539632:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117491.539763:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362450944 00000100:00100000:0.0:1789117491.539772:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362450944 00000100:00100000:0.0:1789117491.539839:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 236 00000100:00100000:0.0:1789117491.539849:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+29:11862:x1876025362450944:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:0.0:1789117491.539873:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117491.539903:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460ec24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cb34 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117491.539996:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ec2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117491.540010:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ec2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117491.540025:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ec2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117491.540036:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789117491.540153:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc800/0xf7565228e460ec24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb34 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117491.540170:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ec2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb34 expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117491.540193:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:0.0:1789117491.540196:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789117491.540200:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbca00, rc 0) 00000100:00100000:0.0:1789117491.540256:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+31:11862:x1876025362450944:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 409us (632us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1789117491.540263:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 236 00000100:00100000:0.0:1789117491.549699:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117491.556175:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362451072 00000100:00100000:2.0:1789117491.556189:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362451072 00000100:00100000:2.0:1789117491.556247:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 237 00000100:00100000:2.0:1789117491.556256:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+31:11862:x1876025362451072:12345-192.168.206.37@tcp:54:lfs.0 00010000:00010000:2.0:1789117491.556318:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460ec39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117491.556335:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460ec39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117491.556346:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460ec39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117491.556371:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460ec39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117491.556378:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460ec39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117491.556396:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460ec39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117491.556423:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117491.556427:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460ec39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117491.556435:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460ec39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117491.556446:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:2.0:1789117491.556449:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789117491.556454:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460ec39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117491.556460:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460ec39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117491.558457:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+31:11862:x1876025362451072:12345-192.168.206.37@tcp:54:lfs.0 Request processed in 2192us (8757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117491.558469:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 237 00000100:00100000:0.0:1789117491.671379:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117491.674339:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362451200 00000100:00100000:2.0:1789117491.674354:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362451200 00000100:00100000:2.0:1789117491.674472:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 71 00000100:00100000:2.0:1789117491.674485:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+7:2351:x1876025362451200:12345-192.168.206.37@tcp:101:cat.0 00010000:00010000:2.0:1789117491.674504:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117491.674526:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061eb7368/0xf7565228e460ec40 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cb3b expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789117491.674581:0:8269:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa3c42f, atime: 0x6aa3c42f, ctime: 0x6aa3c42f, blocks: 0xb 00010000:00010000:2.0:1789117491.674601:0:8269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=338s v=(0 0) 00010000:00010000:2.0:1789117491.674606:0:8269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117491.674615:0:8269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061eb7368/0xf7565228e460ec40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb3b expref: 8 pid: 8269 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117491.674633:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000061eb7368/0xf7565228e460ec40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb3b expref: 8 pid: 8269 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117491.674647:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457e800, rc 0) 00000100:00100000:2.0:1789117491.674716:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+8:2351:x1876025362451200:12345-192.168.206.37@tcp:101:cat.0 Request processed in 234us (3346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117491.674723:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 71 00000100:00080000:1.0:1789117491.675322:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117491.683834:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117491.684434:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362451328 00000100:00100000:2.0:1789117491.684444:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362451328 00002000:00100000:2.0:1789117491.684494:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9c17b8784b40 x1876025362451328/t0(0) o3->e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp:42/0 lens 488/0 e 0 to 0 dl 1789117502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789117491.684506:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c17b8784b40 with x1876025362451328 ext(0->4095) 00002000:00010000:2.0:1789117491.684512:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c17b8784b40 00000100:00100000:2.0:1789117491.684545:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 7 00000100:00100000:2.0:1789117491.684555:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8784b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e0c4e520-7af6-449d-969f-b46035974613+8:2352:x1876025362451328:12345-192.168.206.37@tcp:3:cat.0 00000100:00100000:2.0:1789117491.684802:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8784b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e0c4e520-7af6-449d-969f-b46035974613+8:2352:x1876025362451328:12345-192.168.206.37@tcp:3:cat.0 Request processed in 247us (976us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789117491.684826:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 7 00002000:00100000:2.0:1789117491.684834:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9c17b8784b40 x1876025362451328/t0(0) o3->e0c4e520-7af6-449d-969f-b46035974613@192.168.206.37@tcp:42/0 lens 488/4536 e 0 to 0 dl 1789117502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789117491.684843:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c17b8784b40 with x1876025362451328 ext(0->4095) 00002000:00010000:2.0:1789117491.684857:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c17b8784b40 00000100:00100000:0.0:1789117491.866514:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117491.866554:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117491.866590:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117491.866671:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362451584 00000100:00100000:3.0:1789117491.866681:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362451584 00000100:00100000:3.0:1789117491.866761:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 86 00000100:00100000:3.0:1789117491.866803:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+5:2351:x1876025362451584:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117491.866887:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0c4e520-7af6-449d-969f-b46035974613+5:2351:x1876025362451584:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 102us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117491.866906:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 86 00000100:00080000:0.0:1789117491.867110:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789117491.867430:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362451712 00000100:00100000:1.0:1789117491.867436:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362451712 00000100:00100000:1.0:1789117491.867521:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 150 00000100:00100000:1.0:1789117491.867529:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362451712:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117491.867570:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:2351:x1876025362451712:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 42us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117491.867577:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 150 00000100:00100000:2.0:1789117491.867761:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362451456 00000100:00100000:2.0:1789117491.867766:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362451456 00000100:00100000:2.0:1789117491.867815:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 318 00000100:00100000:2.0:1789117491.867823:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2351:x1876025362451456:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117491.867870:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2351:x1876025362451456:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 47us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117491.867877:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 318 00000100:00080000:0.0:1789117491.869389:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789117492.037707:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117492.806640:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b885da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385500800:0@lo:400:kworker.0 00000100:00100000:0.0:1789117492.806710:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117492.806769:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789117492.806776:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876025385500672:0@lo:400:kworker.0 00000100:00100000:0.0:1789117492.806800:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117492.806816:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b885c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385501184:0@lo:400:kworker.0 00000100:00100000:0.0:1789117492.806840:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117492.806919:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385500544:0@lo:400:kworker.0 00000100:00100000:2.0:1789117492.806955:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117492.806985:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b885fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876025385501056:0@lo:400:kworker.0 00000100:00100000:2.0:1789117492.807006:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117492.807021:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789117492.807027:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b885f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385500928:0@lo:400:kworker.0 00000100:00100000:2.0:1789117492.807048:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117492.807078:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385500800 00000100:00100000:2.0:1789117492.807085:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385500800 00000100:00100000:2.0:1789117492.807135:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385500672 00000100:00100000:2.0:1789117492.807139:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385500672 00000100:00100000:2.0:1789117492.807154:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789117492.807163:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385500800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117492.807220:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385500800:12345-0@lo:400:kworker.0 Request processed in 57us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117492.807226:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789117492.807243:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385501056 00000100:00100000:2.0:1789117492.807245:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385501056 00000100:00100000:2.0:1789117492.807260:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789117492.807265:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0141e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876025385500672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117492.807290:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0141e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876025385500672:12345-0@lo:400:kworker.0 Request processed in 25us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117492.807295:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789117492.807306:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789117492.807311:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876025385501056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117492.807338:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876025385501056:12345-0@lo:400:kworker.0 Request processed in 27us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117492.807343:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789117492.807363:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385501184 00000100:00100000:2.0:1789117492.807366:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385501184 00000100:00100000:2.0:1789117492.807391:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385500928 00000100:00100000:2.0:1789117492.807394:0:8269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385500928 00000100:00100000:2.0:1789117492.807435:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789117492.807442:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0141680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385501184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117492.807472:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0141680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385501184:12345-0@lo:400:kworker.0 Request processed in 31us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117492.807478:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789117492.807489:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789117492.807495:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3301:x1876025385500928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117492.807528:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3301:x1876025385500928:12345-0@lo:400:kworker.0 Request processed in 34us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117492.807534:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1789117492.807552:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789117492.807556:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789117492.807559:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117492.807593:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b885f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385500928:0@lo:400:kworker.0 00000100:00100000:2.0:1789117492.807603:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b885fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876025385501056:0@lo:400:kworker.0 00000100:00100000:2.0:1789117492.807631:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876025385500672:0@lo:400:kworker.0 00000100:00100000:2.0:1789117492.807639:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1789117492.807643:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c17c087a940, transno 4294967307 00000004:00080000:2.0:1789117492.807655:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1789117492.807673:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c1681ef2d00, transno 4294967310 00000100:00100000:2.0:1789117492.807678:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b885c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385501184:0@lo:400:kworker.0 00000100:00100000:2.0:1789117492.807688:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b885da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385500800:0@lo:400:kworker.0 00000100:00100000:0.0:1789117492.807982:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385500544 00000100:00100000:0.0:1789117492.807987:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385500544 00000100:00100000:0.0:1789117492.808021:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1789117492.808029:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3301:x1876025385500544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117492.808082:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785c6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3301:x1876025385500544:12345-0@lo:400:kworker.0 Request processed in 54us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117492.808088:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1789117492.808123:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385500544:0@lo:400:kworker.0 00010000:00010000:3.0:1789117493.061589:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117493.317853:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117493.317873:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0257c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385501312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789117493.317995:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117493.318135:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385501440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117493.318165:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117493.318322:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385501312 00000100:00100000:2.0:1789117493.318329:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385501312 00000100:00100000:2.0:1789117493.318364:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385501440 00000100:00100000:2.0:1789117493.318367:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385501440 00000100:00100000:2.0:1789117493.318385:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789117493.318393:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681487c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3298:x1876025385501312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789117493.318459:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789117493.318505:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681487c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3298:x1876025385501312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117493.318526:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789117493.318548:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789117493.318555:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681486d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385501440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789117493.318574:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117493.318661:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0257c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385501312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117493.323179:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681486d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385501440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4615us (5003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117493.323193:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789117493.327354:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385501440:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789117494.085576:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789117494.412608:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1789117494.413950:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c17b7f43240 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1789117494.413958:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1788cb0000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c17b7f43b40 00000020:00080000:2.0:1789117494.413961:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1788cb0600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c17c025e400 00000020:00080000:2.0:1789117494.413980:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1789117494.414293:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1789117494.414570:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1789117494.426178:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1789117494.426687:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:0.0:1789117495.112250:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117495.800990:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117495.801594:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362451840 00000100:00100000:2.0:1789117495.801604:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362451840 00000100:00080000:0.0:1789117495.802094:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117495.802234:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 238 00000100:00100000:2.0:1789117495.802246:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+18:11506:x1876025362451840:12345-192.168.206.37@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789117495.802355:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0c4e520-7af6-449d-969f-b46035974613+18:11506:x1876025362451840:12345-192.168.206.37@tcp:60:lhsmtool_posix.0 Request processed in 112us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117495.802363:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 238 00000100:00100000:2.0:1789117495.805525:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117495.805644:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362452096 00000100:00100000:3.0:1789117495.805653:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362452096 00000100:00100000:3.0:1789117495.805710:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 65 00000100:00100000:3.0:1789117495.805721:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0255680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+18:11506:x1876025362452096:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789117495.806478:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0255680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+19:11506:x1876025362452096:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 Request processed in 755us (957us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1789117495.806488:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 65 00000100:00100000:1.0:1789117496.096376:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117496.096568:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362452224 00000100:00100000:2.0:1789117496.096577:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362452224 00000100:00100000:2.0:1789117496.096697:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 239 00000100:00100000:2.0:1789117496.096707:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+5:12314:x1876025362452224:12345-192.168.206.37@tcp:101:lsof.0 00010000:00010000:2.0:1789117496.096726:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117496.096756:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460ec47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cb42 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117496.096815:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460ec4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117496.096829:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460ec4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117496.096841:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460ec4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117496.097634:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789117496.097641:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1789117496.097737:0:5839:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460ec4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117496.097767:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460ec47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb42 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117496.097789:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460ec4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb42 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117496.097798:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9e600) 00010000:00010000:2.0:1789117496.097801:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789117496.097805:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457fa00, rc 0) 00000100:00100000:2.0:1789117496.097866:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:12314:x1876025362452224:12345-192.168.206.37@tcp:101:lsof.0 Request processed in 1160us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117496.097888:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 239 00000100:00080000:0.0:1789117496.100091:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789117496.133550:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117496.990973:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117496.991071:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117496.991118:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117496.991153:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117496.991193:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117496.991224:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362452608 00000100:00100000:0.0:1789117496.991233:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362452608 00000100:00100000:0.0:1789117496.991286:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362452736 00000100:00100000:0.0:1789117496.991289:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362452736 00000100:00100000:0.0:1789117496.991312:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 89 00000100:00100000:0.0:1789117496.991321:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681485e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+7:2352:x1876025362452608:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117496.991388:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681485e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+7:2352:x1876025362452608:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 67us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117496.991434:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 89 00000100:00100000:0.0:1789117496.991453:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 90 00000100:00100000:0.0:1789117496.991460:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+5:2352:x1876025362452736:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117496.991489:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+5:2352:x1876025362452736:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 30us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117496.991494:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 90 00000100:00080000:2.0:1789117496.991542:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789117496.991554:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117496.991568:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362452864 00000100:00100000:2.0:1789117496.991572:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362452864 00000100:00100000:3.0:1789117496.991575:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362452480 00000100:00100000:3.0:1789117496.991581:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362452480 00000100:00100000:2.0:1789117496.991610:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 154 00000100:00100000:2.0:1789117496.991620:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16814852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:2352:x1876025362452864:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117496.991631:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 155 00000100:00100000:3.0:1789117496.991641:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c16822b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+19:2352:x1876025362452480:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117496.991656:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16814852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:2352:x1876025362452864:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 37us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117496.991665:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 154 00000100:00100000:3.0:1789117496.991685:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c16822b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0c4e520-7af6-449d-969f-b46035974613+19:2352:x1876025362452480:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 45us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117496.992171:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 155 00000100:00100000:1.0:1789117496.993056:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362452352 00000100:00100000:1.0:1789117496.993065:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362452352 00000100:00100000:1.0:1789117496.993127:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 320 00000100:00100000:1.0:1789117496.993136:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2352:x1876025362452352:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117496.993947:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2352:x1876025362452352:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 807us (2977us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117496.993956:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 320 00010000:00010000:0.0:1789117497.157621:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117497.925629:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c087a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385501824:0@lo:400:kworker.0 00000100:00100000:0.0:1789117497.925697:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117497.925749:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789117497.925756:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876025385501696:0@lo:400:kworker.0 00000100:00100000:0.0:1789117497.925778:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117497.925793:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385502208:0@lo:400:kworker.0 00000100:00100000:0.0:1789117497.925817:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117497.925894:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c16822b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385501568:0@lo:400:kworker.0 00000100:00100000:1.0:1789117497.925927:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117497.925956:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0879680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876025385502080:0@lo:400:kworker.0 00000100:00100000:1.0:1789117497.925978:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117497.925995:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789117497.926001:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c087ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385501952:0@lo:400:kworker.0 00000100:00100000:0.0:1789117497.926014:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385501568 00000100:00100000:0.0:1789117497.926020:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385501568 00000100:00100000:1.0:1789117497.926038:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117497.926058:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789117497.926067:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3301:x1876025385501568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117497.926092:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385502208 00000100:00100000:1.0:1789117497.926096:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385502208 00000100:00100000:0.0:1789117497.926112:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3301:x1876025385501568:12345-0@lo:400:kworker.0 Request processed in 46us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117497.926119:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1789117497.926127:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385501952 00000100:00100000:1.0:1789117497.926130:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385501952 00000100:00100000:1.0:1789117497.926146:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789117497.926152:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385502208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117497.926219:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c16822b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385501568:0@lo:400:kworker.0 00000100:00100000:0.0:1789117497.926247:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789117497.926255:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8785a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385501952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117497.926261:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385502208:12345-0@lo:400:kworker.0 Request processed in 109us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117497.926267:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789117497.926301:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385502208:0@lo:400:kworker.0 00000100:00100000:1.0:1789117497.926328:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1789117497.926332:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c1681ef0f00, transno 4294967321 00000004:00080000:1.0:1789117497.926340:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c1681ef2940, transno 4294967322 00000100:00080000:2.0:1789117497.926447:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789117497.926451:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117497.926460:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385501824 00000100:00100000:2.0:1789117497.926463:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385501824 00000100:00100000:2.0:1789117497.926499:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385501696 00000100:00100000:2.0:1789117497.926503:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385501696 00000100:00100000:2.0:1789117497.926514:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385502080 00000100:00100000:2.0:1789117497.926516:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385502080 00000100:00100000:2.0:1789117497.926528:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789117497.926534:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385501824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117497.926677:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789117497.926686:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876025385501696:12345-0@lo:400:kworker.0 00000004:00080000:1.0:1789117497.926717:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1789117497.926735:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c087ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385501952:0@lo:400:kworker.0 00000100:00080000:1.0:1789117497.927139:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117497.927149:0:5840:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789117497.927156:0:5840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1789117497.930092:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789117497.930093:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385501824:12345-0@lo:400:kworker.0 Request processed in 3556us (4392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117497.930102:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789117497.930107:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876025385502080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117497.930158:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c087a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385501824:0@lo:400:kworker.0 00000100:00100000:1.0:1789117497.930169:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876025385502080:12345-0@lo:400:kworker.0 Request processed in 69us (4191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117497.930175:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789117497.930203:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0879680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876025385502080:0@lo:400:kworker.0 00000100:00100000:3.0:1789117497.930919:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876025385501696:12345-0@lo:400:kworker.0 Request processed in 4232us (5137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117497.930927:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789117497.931008:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876025385501696:0@lo:400:kworker.0 00000100:00100000:0.0:1789117497.932529:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8785a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385501952:12345-0@lo:400:kworker.0 Request processed in 6269us (6483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117497.932541:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00010000:0.0:1789117498.181958:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789117498.309652:0:12082:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789117498.309674:0:12082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789117498.309945:0:12082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1789117498.309952:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789117498.437739:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117498.437761:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0254b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385502336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117498.437834:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117498.438071:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385502336 00000100:00100000:0.0:1789117498.438079:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385502336 00000100:00100000:0.0:1789117498.438127:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789117498.438137:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7b22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385502336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789117498.438168:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789117498.438226:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7b22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385502336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117498.438234:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789117498.438644:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0254b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385502336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117498.438758:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789117498.438769:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385502464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117498.438805:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117498.438891:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385502464 00000100:00100000:3.0:1789117498.438896:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385502464 00000100:00100000:3.0:1789117498.438931:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789117498.438938:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385502464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117498.438959:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117498.439003:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385502464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117498.439009:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789117498.439153:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385502464:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789117499.216929:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789117499.532457:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1789117499.532469:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1789117499.532701:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789117499.532711:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:2.0:1789117499.619264:0:13215:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 05:04:57 (1789117497) 00010000:00010000:0.0:1789117500.230143:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117501.253597:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117502.108799:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117502.108862:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117502.108892:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362452992 00000100:00100000:1.0:1789117502.108902:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362452992 00000100:00100000:2.0:1789117502.108903:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117502.108940:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117502.108959:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 322 00000100:00100000:1.0:1789117502.108971:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2350:x1876025362452992:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117502.108975:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117502.109002:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362453504 00000100:00100000:2.0:1789117502.109007:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362453504 00000100:00100000:1.0:1789117502.109044:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2350:x1876025362452992:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 75us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117502.109054:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362453120 00000100:00100000:1.0:1789117502.109054:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 322 00000100:00100000:2.0:1789117502.109059:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362453120 00000100:00100000:2.0:1789117502.109087:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 159 00000100:00080000:1.0:1789117502.109093:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117502.109095:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:2350:x1876025362453504:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117502.109131:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:2350:x1876025362453504:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 37us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117502.109138:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 159 00000100:00100000:2.0:1789117502.109165:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 160 00000100:00100000:2.0:1789117502.109175:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0254780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+18:2350:x1876025362453120:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117502.109212:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0254780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+18:2350:x1876025362453120:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 40us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117502.109219:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 160 00000100:00100000:1.0:1789117502.109230:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362453248 00000100:00100000:1.0:1789117502.109236:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362453248 00000100:00080000:2.0:1789117502.109267:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117502.109275:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362453376 00000100:00100000:1.0:1789117502.109279:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362453376 00000100:00100000:2.0:1789117502.109293:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 93 00000100:00100000:2.0:1789117502.109302:0:8269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0254b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+7:2350:x1876025362453248:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117502.109315:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 94 00000100:00100000:1.0:1789117502.109325:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0257c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+5:2350:x1876025362453376:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117502.109332:0:8269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0254b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0c4e520-7af6-449d-969f-b46035974613+7:2350:x1876025362453248:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 31us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117502.109351:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 93 00000100:00100000:1.0:1789117502.109357:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0257c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+5:2350:x1876025362453376:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 33us (383us total) trans 0 rc 0/0 00000100:00080000:3.0:1789117502.109450:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789117502.110788:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 94 00010000:00010000:0.0:1789117502.277552:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117503.036240:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117503.038387:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362453760 00000100:00100000:3.0:1789117503.038421:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362453760 00000100:00100000:3.0:1789117503.038520:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 66 00000100:00100000:3.0:1789117503.038534:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+18:12535:x1876025362453760:12345-192.168.206.37@tcp:35:umount.0 00000100:00100000:3.0:1789117503.039258:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+19:12535:x1876025362453760:12345-192.168.206.37@tcp:35:umount.0 Request processed in 724us (3029us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1789117503.039277:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 66 00000100:00100000:0.0:1789117503.046195:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117503.046237:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362454016 00000100:00100000:0.0:1789117503.046246:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362454016 00000100:00100000:1.0:1789117503.046281:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c087ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876025385502720:0@lo:400:kworker.0 00000100:00100000:0.0:1789117503.046302:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 67 00000100:00100000:0.0:1789117503.046314:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+19:12535:x1876025362454016:12345-192.168.206.37@tcp:35:umount.0 00000100:00100000:1.0:1789117503.046334:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117503.046387:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385503232:0@lo:400:kworker.0 00000100:00100000:1.0:1789117503.046482:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117503.046668:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+20:12535:x1876025362454016:12345-192.168.206.37@tcp:35:umount.0 Request processed in 356us (479us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1789117503.046676:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 67 00000100:00100000:0.0:1789117503.046823:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0879680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385502848:0@lo:400:kworker.0 00000100:00100000:0.0:1789117503.046875:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117503.046922:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385502720 00000100:00100000:0.0:1789117503.046926:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385502720 00000100:00100000:0.0:1789117503.046948:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385502848 00000100:00100000:0.0:1789117503.046951:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385502848 00000100:00100000:0.0:1789117503.046976:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789117503.046982:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876025385502720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117503.047016:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876025385502720:12345-0@lo:400:kworker.0 Request processed in 34us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117503.047022:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789117503.047036:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789117503.047042:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385502848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117503.047073:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385502848:12345-0@lo:400:kworker.0 Request processed in 32us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117503.047079:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1789117503.047095:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117503.047119:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0879680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385502848:0@lo:400:kworker.0 00000100:00100000:1.0:1789117503.047327:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c087ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876025385502720:0@lo:400:kworker.0 00000100:00100000:0.0:1789117503.047418:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385503232 00000100:00100000:0.0:1789117503.047423:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385503232 00000100:00100000:0.0:1789117503.047467:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789117503.047474:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b88521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385503232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117503.047511:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b88521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385503232:12345-0@lo:400:kworker.0 Request processed in 38us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117503.047517:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789117503.047547:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385502976:0@lo:400:kworker.0 00000100:00100000:0.0:1789117503.047575:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117503.047622:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00080000:1.0:1789117503.047624:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789117503.047631:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c087a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385502592:0@lo:400:kworker.0 00000100:00100000:0.0:1789117503.047674:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117503.047685:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385502976 00000100:00100000:3.0:1789117503.047697:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385502976 00000100:00100000:0.0:1789117503.047709:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c1d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876025385503104:0@lo:400:kworker.0 00000100:00100000:0.0:1789117503.047746:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117503.047769:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789117503.047783:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385502976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117503.047793:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385502592 00000100:00100000:0.0:1789117503.047800:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385502592 00000100:00100000:0.0:1789117503.047848:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789117503.047856:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178311bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385502592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117503.047893:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178311bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3300:x1876025385502592:12345-0@lo:400:kworker.0 Request processed in 38us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117503.047899:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00080000:1.0:1789117503.047913:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117503.047941:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c087a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385502592:0@lo:400:kworker.0 00000100:00100000:1.0:1789117503.048026:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d52d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385503232:0@lo:400:kworker.0 00000100:00100000:1.0:1789117503.048058:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385503104 00000100:00100000:1.0:1789117503.048062:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385503104 00000100:00100000:1.0:1789117503.048104:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789117503.048111:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876025385503104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117503.048150:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876025385503104:12345-0@lo:400:kworker.0 Request processed in 39us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117503.048157:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789117503.048183:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876025385503104:0@lo:400:kworker.0 00000100:00080000:0.0:1789117503.048592:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117503.048612:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385502976:12345-0@lo:400:kworker.0 Request processed in 829us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117503.048622:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789117503.048672:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c1d512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385502976:0@lo:400:kworker.0 00000100:00100000:1.0:1789117503.051779:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117503.051881:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362454272 00000100:00100000:0.0:1789117503.051895:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362454272 00000100:00100000:0.0:1789117503.052026:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 68 00000100:00100000:0.0:1789117503.052037:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17a9733050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+20:12535:x1876025362454272:12345-192.168.206.37@tcp:35:umount.0 00000100:00100000:0.0:1789117503.052545:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17a9733050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0c4e520-7af6-449d-969f-b46035974613+21:12535:x1876025362454272:12345-192.168.206.37@tcp:35:umount.0 Request processed in 507us (777us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789117503.052553:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 68 00000100:00100000:0.0:1789117503.055350:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117503.055512:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362454528 00000100:00100000:3.0:1789117503.055520:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362454528 00000100:00100000:3.0:1789117503.055573:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 69 00000100:00100000:3.0:1789117503.055584:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+21:12535:x1876025362454528:12345-192.168.206.37@tcp:35:umount.0 00000100:00100000:3.0:1789117503.056890:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0c4e520-7af6-449d-969f-b46035974613+22:12535:x1876025362454528:12345-192.168.206.37@tcp:35:umount.0 Request processed in 1302us (1541us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789117503.056901:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 69 00000100:00100000:1.0:1789117503.063869:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117503.063968:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117503.074692:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117503.076740:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362454784 00000100:00100000:3.0:1789117503.076753:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362454784 00000100:00100000:3.0:1789117503.076844:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362454656 00000100:00100000:3.0:1789117503.076848:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362454656 00000100:00100000:3.0:1789117503.076877:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 18 00000100:00100000:3.0:1789117503.076885:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8852d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+14:2352:x1876025362454784:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117503.076901:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117503.076919:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1781684a00/0xf7565228e460dbed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c687 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117503.076936:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117503.077008:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8852d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+13:2352:x1876025362454784:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 122us (13147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117503.077016:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 18 00000100:00100000:3.0:1789117503.077034:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 19 00000100:00100000:3.0:1789117503.077041:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:2352:x1876025362454656:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117503.077048:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117503.077057:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1780031400/0xf7565228e460dc87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6bf expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117503.077068:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117503.077086:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:2352:x1876025362454656:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 47us (13119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117503.077093:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 19 00000100:00100000:1.0:1789117503.077749:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117503.077775:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362455040 00000100:00100000:1.0:1789117503.077781:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362455040 00000100:00100000:1.0:1789117503.077812:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 72 00000100:00100000:1.0:1789117503.077820:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8852d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+5:2348:x1876025362455040:12345-192.168.206.37@tcp:9:umount.0 00000020:00000080:1.0:1789117503.077854:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460df9e 00000100:00080000:1.0:1789117503.077862:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9c17bfa8f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789117503.077896:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1789117503.078119:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8852d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0c4e520-7af6-449d-969f-b46035974613+2:2348:x1876025362455040:12345-192.168.206.37@tcp:9:umount.0 Request processed in 299us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117503.078135:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 72 00000100:00100000:0.0:1789117503.078244:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362454912 00000100:00100000:0.0:1789117503.078249:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362454912 00010000:00010000:1.0:1789117503.078330:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117503.079549:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 20 00000100:00100000:2.0:1789117503.079563:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b88530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:2349:x1876025362454912:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117503.079579:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117503.079597:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178442f600/0xf7565228e460deb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c798 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117503.079627:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117503.079673:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b88530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2349:x1876025362454912:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 113us (4989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117503.079680:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 20 00000100:00100000:1.0:1789117503.094485:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117503.094585:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362455424 00000100:00100000:2.0:1789117503.094595:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362455424 00000100:00100000:2.0:1789117503.094663:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 73 00000100:00100000:2.0:1789117503.094673:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+7:2348:x1876025362455424:12345-192.168.206.37@tcp:9:umount.0 00000020:00000080:2.0:1789117503.094706:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460e1ff 00000020:00010000:2.0:1789117503.094715:0:6687:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c1787217000: total 0 00000100:00080000:2.0:1789117503.094720:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9c17c03a1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789117503.094753:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1789117503.095016:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0c4e520-7af6-449d-969f-b46035974613+5:2348:x1876025362455424:12345-192.168.206.37@tcp:9:umount.0 Request processed in 342us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117503.095025:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 73 00000020:00010000:0.0:1789117503.095630:0:5829:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c1787217000: total 0 00010000:00010000:0.0:1789117503.095664:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c1787217000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789117503.095716:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061eb7368/0xf7565228e460ec40 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb3b expref: 4 pid: 8269 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117503.095763:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfa458fd/0xf7565228e460e5a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c96d expref: 3 pid: 8269 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117503.095778:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c1787217000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789117503.095790:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117503.095793:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117503.095794:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117503.103618:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117503.103879:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362456448 00000100:00100000:0.0:1789117503.103888:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362456448 00000100:00100000:0.0:1789117503.103938:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 240 00000100:00100000:0.0:1789117503.103948:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+22:2348:x1876025362456448:12345-192.168.206.37@tcp:39:umount.0 00000020:00000080:0.0:1789117503.103982:0:5841:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460dbfb 00000020:00010000:0.0:1789117503.103996:0:5841:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c17b8bea800: total 0 00000100:00080000:0.0:1789117503.104000:0:5841:0:(import.c:65:import_set_state_nolock()) ffff9c17b8bee000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789117503.104030:0:5841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1789117503.104375:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c17b8bea800: total 0 00010000:00010000:3.0:1789117503.104380:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117503.104438:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c17b8bea800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789117503.104469:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:3.0:1789117503.104473:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789117503.104482:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbdc00/0xf7565228e460e620 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c990 expref: 21 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117503.104500:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:3.0:1789117503.104502:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789117503.104506:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460e483 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c920 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117503.104519:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:3.0:1789117503.104534:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789117503.104540:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f800/0xf7565228e460df74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7c2 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117503.104556:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:3.0:1789117503.104559:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789117503.104562:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f200/0xf7565228e460eb21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9caee expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117503.104574:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1788d9e000) 00010000:00010000:3.0:1789117503.104576:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117503.104580:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f200/0xf7565228e460df20 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7ad expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117503.104596:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:3.0:1789117503.104598:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789117503.104602:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1781685200/0xf7565228e460e58d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c966 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117503.104613:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:3.0:1789117503.104615:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789117503.104618:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7200/0xf7565228e460ec01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb26 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117503.104630:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9e600) 00010000:00010000:3.0:1789117503.104633:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789117503.104636:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e000/0xf7565228e460e604 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c989 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117503.104660:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c1782df4200) 00010000:00010000:3.0:1789117503.104662:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789117503.104666:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460ec2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb34 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117503.104679:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c1783e89c00) 00010000:00010000:3.0:1789117503.104681:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789117503.104684:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e600/0xf7565228e460e563 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c958 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117503.104696:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c1788d9eb00) 00010000:00010000:3.0:1789117503.104699:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789117503.104702:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbc600/0xf7565228e460e261 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c894 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117503.104714:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c1788d9e300) 00010000:00010000:3.0:1789117503.104717:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789117503.104720:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460df04 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c7a6 expref: 10 pid: 7242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117503.104735:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c1782c0ec00) 00010000:00010000:3.0:1789117503.104737:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789117503.104741:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fa00/0xf7565228e460e8ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ca62 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117503.104755:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c17b8bea800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1789117503.104767:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117503.104774:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117503.104776:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117503.105671:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0c4e520-7af6-449d-969f-b46035974613+7:2348:x1876025362456448:12345-192.168.206.37@tcp:39:umount.0 Request processed in 1720us (2070us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789117503.105682:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 240 00010000:00010000:0.0:1789117503.302595:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117503.557797:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789117503.557839:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385503488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117503.557859:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117503.557872:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385503360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117503.563860:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117503.563942:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385503488 00000100:00100000:0.0:1789117503.563957:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385503488 00000100:00100000:0.0:1789117503.564031:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789117503.564041:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385503488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789117503.564089:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117503.565444:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117503.566748:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385503488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2701us (2893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117503.566783:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789117503.566824:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385503360 00000100:00100000:0.0:1789117503.567031:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385503360 00000100:00100000:3.0:1789117503.567172:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789117503.567188:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385503360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117503.567235:0:6688:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789117503.567260:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1789117503.567268:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1789117503.567308:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385503360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117503.567315:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789117503.567643:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385503360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117503.567849:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385503488:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789117504.325670:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789117504.657277:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e0c4e520-7af6-449d-969f-b46035974613 00000020:00000080:2.0:1789117504.657289:0:7650:0:(genops.c:885:class_export_put()) final put ffff9c17bfa8e000/e0c4e520-7af6-449d-969f-b46035974613 00000020:00000080:2.0:1789117504.657326:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17bfa8e000/e0c4e520-7af6-449d-969f-b46035974613 for lustre-OST0001 00000020:00000080:2.0:1789117504.657381:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c17bfa8f000 for lustre-OST0001 00000001:00100000:2.0:1789117504.657783:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e0c4e520-7af6-449d-969f-b46035974613 00000001:00080000:2.0:1789117504.657798:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1789117504.657817:0:5862:0:(genops.c:885:class_export_put()) final put ffff9c17b8bea800/e0c4e520-7af6-449d-969f-b46035974613 00000020:00000080:1.0:1789117504.658287:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17b8bea800/e0c4e520-7af6-449d-969f-b46035974613 for lustre-MDT0000 00000020:00000080:1.0:1789117504.658370:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c17b8bee000 for lustre-MDT0000 00000001:00100000:3.0:1789117504.668016:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e0c4e520-7af6-449d-969f-b46035974613 00000020:00000080:3.0:1789117504.668029:0:6713:0:(genops.c:885:class_export_put()) final put ffff9c1787217000/e0c4e520-7af6-449d-969f-b46035974613 00000020:00000080:0.0:1789117504.668129:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1787217000/e0c4e520-7af6-449d-969f-b46035974613 for lustre-OST0000 00000020:00000080:0.0:1789117504.668200:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c17c03a1000 for lustre-OST0000 00000100:00100000:1.0:1789117504.869740:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117504.869888:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117504.874979:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117504.896847:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362456576 00000100:00100000:2.0:1789117504.896887:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362456576 00000100:00100000:2.0:1789117504.896979:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362456704 00000100:00100000:2.0:1789117504.896984:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362456704 00000100:00100000:2.0:1789117504.897003:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362456832 00000100:00100000:2.0:1789117504.897007:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362456832 00000100:00100000:2.0:1789117504.897035:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 21 00000100:00100000:2.0:1789117504.897047:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c1d52d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+12:2351:x1876025362456576:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117504.897069:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117504.897097:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178457f000/0xf7565228e460dccd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6d4 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117504.897120:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117504.899549:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 22 00000100:00100000:0.0:1789117504.899581:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+11:2351:x1876025362456704:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117504.899608:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117504.899637:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178149c200/0xf7565228e460dcd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6fe expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117504.899670:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117504.905557:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c1d52d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+10:2351:x1876025362456576:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 8495us (36034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117504.905576:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 21 00000100:00100000:2.0:1789117504.905635:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 23 00000100:00100000:2.0:1789117504.905665:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+9:2351:x1876025362456832:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117504.905686:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117504.905725:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178457fc00/0xf7565228e460dea9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c791 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117504.905745:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117504.907548:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+8:2351:x1876025362456704:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 7967us (37643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117504.907565:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 22 00000100:00100000:2.0:1789117504.908336:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+7:2351:x1876025362456832:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 2685us (33365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117504.908358:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 23 00000100:00100000:0.0:1789117504.916545:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117504.917284:0:13177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362457088 00000100:00100000:1.0:1789117504.917300:0:13177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362457088 00000100:00100000:1.0:1789117504.917493:0:13177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 241 00000100:00100000:1.0:1789117504.917516:0:13177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+6:2348:x1876025362457088:12345-192.168.206.37@tcp:39:umount.0 00000020:00000080:1.0:1789117504.917573:0:13177:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460dce2 00000020:00010000:1.0:1789117504.917582:0:13177:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c16816b6800: total 0 00000100:00080000:1.0:1789117504.917588:0:13177:0:(import.c:65:import_set_state_nolock()) ffff9c16816b4800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789117504.917620:0:13177:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:2.0:1789117504.918224:0:5829:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c16816b6800: total 0 00010000:00010000:2.0:1789117504.918279:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c16816b6800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789117504.918322:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1788d9e600) 00010000:00010000:2.0:1789117504.918326:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789117504.918337:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fa00/0xf7565228e460ec4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb42 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117504.918379:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c16816b6800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789117504.918389:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117504.918392:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117504.918394:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117504.919735:0:13177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc+3:2348:x1876025362457088:12345-192.168.206.37@tcp:39:umount.0 Request processed in 2220us (3192us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1789117504.919751:0:13177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 241 00000100:00080000:0.0:1789117504.924844:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117504.939222:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117504.939459:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362457344 00000100:00100000:1.0:1789117504.939472:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362457344 00000100:00100000:1.0:1789117504.939549:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 324 00000100:00100000:1.0:1789117504.939580:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+7:2348:x1876025362457344:12345-192.168.206.37@tcp:251:umount.0 00000020:00000080:1.0:1789117504.939644:0:5835:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460dbd8 00000020:00010000:1.0:1789117504.939671:0:5835:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c17b7c53000: total 0 00000100:00080000:1.0:1789117504.939678:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9c17b7c57000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1789117504.939769:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c17b7c53000: total 0 00010000:00010000:3.0:1789117504.939776:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117504.939782:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712c9f48-d1f0-41ea-ba66-2b9a8d7109b1+3:2348:x1876025362457344:12345-192.168.206.37@tcp:251:umount.0 Request processed in 203us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117504.939792:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 324 00010000:00010000:3.0:1789117504.939844:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c17b7c53000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789117504.939893:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1787cbd200/0xf7565228e460dc8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9c6c6 expref: 2 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117504.939920:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c17b7c53000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789117504.939930:0:5828:0:(genops.c:885:class_export_put()) final put ffff9c17b7c53000/712c9f48-d1f0-41ea-ba66-2b9a8d7109b1 00010000:00010000:3.0:1789117504.939952:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117504.939955:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117504.939957:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789117504.940049:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17b7c53000/712c9f48-d1f0-41ea-ba66-2b9a8d7109b1 for MGS 00000020:00000080:1.0:1789117504.940097:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c17b7c57000 for MGS 00010000:00010000:3.0:1789117505.349962:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117506.373615:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789117506.540156:0:13415:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789117506.557646:0:13415:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789117506.557695:0:13415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149ca00/0xf7565228e460dc5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc64 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.557710:0:13415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149ca00/0xf7565228e460dc5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dc64 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.557718:0:13415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178149ca00/0xf7565228e460dc5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460dc64 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.557725:0:13415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.137@tcp lock: ffff9c178149ca00/0xf7565228e460dc5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460dc64 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.557757:0:13415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789117506.557764:0:13415:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789117506.557788:0:13415:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789117506.557793:0:13415:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789117506.557798:0:13415:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789117506.557834:0:13415:0:(import.c:65:import_set_state_nolock()) ffff9c17a7c14800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789117506.557865:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876025385503616:0@lo:39:umount.0 00000100:00100000:2.0:1789117506.557935:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789117506.558465:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117506.558474:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c178149ca00/0xf7565228e460dc5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460dc64 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.558485:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178149ca00 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:2.0:1789117506.558568:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c178149ca00/0xf7565228e460dc5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460dc64 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.558579:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178149ca00/0xf7565228e460dc5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7565228e460dc64 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117506.558588:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178149ca00/0xf7565228e460dc5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7565228e460dc64 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117506.558670:0:7242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385503616 00000100:00100000:1.0:1789117506.558678:0:7242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385503616 00000100:00100000:1.0:1789117506.558729:0:7242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789117506.558739:0:7242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1876025385503616:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789117506.558767:0:7242:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460d9e7 00000100:00080000:1.0:1789117506.558776:0:7242:0:(import.c:65:import_set_state_nolock()) ffff9c1787e50800 : changing import state from FULL to CLOSED 10000000:01000000:2.0:1789117506.558807:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789117506.558810:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789117506.558829:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789117506.558858:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c178149ca00/0xf7565228e460dc5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460dc64 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117506.558860:0:7242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3297:x1876025385503616:12345-0@lo:39:umount.0 Request processed in 121us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117506.558874:0:7242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1789117506.558885:0:7242:0:(genops.c:885:class_export_put()) final put ffff9c17a9768800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1789117506.558892:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117506.558915:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117506.558919:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c178149ca00/0xf7565228e460dc5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460dc64 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789117506.558927:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17a9768800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:2.0:1789117506.558928:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178149ca00/0xf7565228e460dc5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460dc64 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.558945:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117506.558947:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117506.558949:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117506.558963:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385503744:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1789117506.558978:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c1787e50800 for lustre-MDT0000 00000100:00100000:2.0:1789117506.559004:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789117506.559016:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c17a7c14800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789117506.559031:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876025385503616:0@lo:39:umount.0 00000100:00080000:2.0:1789117506.559053:0:13415:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789117506.559058:0:13415:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789117506.559062:0:13415:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1789117506.560074:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385503744 00000100:00100000:3.0:1789117506.560083:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385503744 00000100:00100000:3.0:1789117506.560136:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789117506.560145:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3301:x1876025385503744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789117506.561756:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117506.561782:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1780030800/0xf7565228e460dc64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7565228e460dc5d expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117506.561820:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117506.561905:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:3301:x1876025385503744:12345-0@lo:103:ldlm_bl.0 Request processed in 1760us (2901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117506.561913:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789117506.562000:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385503744:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789117506.563344:0:13415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457fe00/0xf7565228e460dc6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc72 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.563365:0:13415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457fe00/0xf7565228e460dc6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dc72 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.563373:0:13415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457fe00/0xf7565228e460dc6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460dc72 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.563380:0:13415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.137@tcp lock: ffff9c178457fe00/0xf7565228e460dc6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460dc72 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.563420:0:13415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117506.563440:0:13415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1780031000/0xf7565228e460db92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460db99 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.563447:0:13415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1780031000/0xf7565228e460db92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460db99 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.563453:0:13415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1780031000/0xf7565228e460db92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460db99 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.563459:0:13415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.137@tcp lock: ffff9c1780031000/0xf7565228e460db92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460db99 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.563476:0:13415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789117506.563482:0:13415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2044800/0xf7565228e460ded3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460deda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.563494:0:13415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2044800/0xf7565228e460ded3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460deda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.563501:0:13415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2044800/0xf7565228e460ded3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460deda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.563508:0:13415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.137@tcp lock: ffff9c17c2044800/0xf7565228e460ded3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460deda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.563515:0:13415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789117506.563521:0:13415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2045a00/0xf7565228e460d946 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460d94d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.563527:0:13415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2045a00/0xf7565228e460d946 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460d94d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.563540:0:13415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2045a00/0xf7565228e460d946 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460d94d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.563545:0:13415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.137@tcp lock: ffff9c17c2045a00/0xf7565228e460d946 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460d94d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117506.563552:0:13415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1789117506.563555:0:13415:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789117506.563583:0:13415:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789117506.563587:0:13415:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789117506.563592:0:13415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789117506.563597:0:13415:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1789117506.563603:0:13415:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c17b86d9000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789117506.563609:0:13415:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c16816f3000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789117506.563616:0:13415:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9c16816b6800 7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc 192.168.206.37@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789117506.563622:0:13415:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9c17882d9a48) has exports, disconnecting them 00000020:00080000:2.0:1789117506.563626:0:13415:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c17b86d9000), last request at 1789117503 00000020:00000080:2.0:1789117506.563634:0:13415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460db5a 00000100:00080000:2.0:1789117506.563649:0:13415:0:(import.c:65:import_set_state_nolock()) ffff9c17b86da800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789117506.563688:0:13415:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c17b86d9000): rc 0 00000020:00000080:2.0:1789117506.563691:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c17b86d9000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789117506.563710:0:13415:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c16816f3000), last request at 1789117503 00000020:00000080:2.0:1789117506.563714:0:13415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460da8f 00000100:00080000:2.0:1789117506.563720:0:13415:0:(import.c:65:import_set_state_nolock()) ffff9c16816f0000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789117506.563728:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:00080000:2.0:1789117506.563729:0:13415:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c16816f3000): rc 0 00000020:00000080:1.0:1789117506.563732:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17b86d9000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789117506.563734:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c16816f3000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1789117506.563736:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c178457fe00/0xf7565228e460dc6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460dc72 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117506.563746:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457fe00 already unused, calling callback (ffffffffc1ce7c20) 00000004:00000080:2.0:1789117506.563750:0:13415:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbc6b00da3ae0 00000100:00080000:2.0:1789117506.563776:0:13415:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789117506.563780:0:13415:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00010000:00010000:0.0:1789117506.563785:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000020:00000080:1.0:1789117506.563788:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c16816f3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000004:00080000:2.0:1789117506.563795:0:13415:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:1.0:1789117506.563824:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c17b86da800 for lustre-MDT0000 00000020:00000080:1.0:1789117506.563837:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c16816f0000 for lustre-MDT0000 00000100:00080000:2.0:1789117506.563887:0:13415:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789117506.563910:0:13415:0:(import.c:65:import_set_state_nolock()) ffff9c16816b5000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 10000000:00010000:3.0:1789117506.563919:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c178457fe00/0xf7565228e460dc6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460dc72 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117506.563930:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178457fe00/0xf7565228e460dc6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7565228e460dc72 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789117506.563932:0:13415:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789117506.563937:0:13415:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 10000000:00010000:3.0:1789117506.563942:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178457fe00/0xf7565228e460dc6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7565228e460dc72 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789117506.563948:0:13415:0:(osp_dev.c:1634:osp_import_event()) got inactive 10000000:01000000:3.0:1789117506.563950:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789117506.563953:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1789117506.563956:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1789117506.563980:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c178457fe00/0xf7565228e460dc6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460dc72 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117506.563986:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117506.564011:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c178457fe00/0xf7565228e460dc6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460dc72 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789117506.564016:0:13415:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00010000:00010000:3.0:1789117506.564027:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178457fe00/0xf7565228e460dc6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460dc72 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789117506.564028:0:13415:0:(import.c:65:import_set_state_nolock()) ffff9c16822f9000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789117506.564042:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385504000:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789117506.564043:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789117506.564047:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c17c2044800/0xf7565228e460ded3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460deda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117506.564054:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2044800 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:3.0:1789117506.564057:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c17c2044800/0xf7565228e460ded3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460deda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117506.564064:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c17c2044800/0xf7565228e460ded3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7565228e460deda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789117506.564065:0:13415:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c17882d9a48) has no exports 10000000:00010000:3.0:1789117506.564074:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c17c2044800/0xf7565228e460ded3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7565228e460deda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117506.564079:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789117506.564082:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789117506.564084:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789117506.564095:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c17c2044800/0xf7565228e460ded3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460deda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117506.564101:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789117506.564101:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789117506.564108:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c17c2044800/0xf7565228e460ded3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460deda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117506.564114:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c17c2044800/0xf7565228e460ded3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460deda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117506.564132:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117506.564135:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c17c2045a00/0xf7565228e460d946 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460d94d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117506.564140:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2045a00 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:3.0:1789117506.564142:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c17c2045a00/0xf7565228e460d946 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460d94d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117506.564145:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1789117506.564149:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c17c2045a00/0xf7565228e460d946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7565228e460d94d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117506.564151:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385504256:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1789117506.564156:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c17c2045a00/0xf7565228e460d946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7565228e460d94d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117506.564174:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1789117506.564293:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789117506.564295:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789117506.564297:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789117506.564311:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c17c2045a00/0xf7565228e460d946 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460d94d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117506.564317:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789117506.564342:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c17c2045a00/0xf7565228e460d946 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460d94d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117506.564349:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c17c2045a00/0xf7565228e460d946 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460d94d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117506.564362:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117506.564364:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117506.564371:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117506.564534:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117506.564544:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385504384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789117506.564570:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117506.564603:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385504000 00000100:00100000:3.0:1789117506.564609:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385504000 00000100:00100000:3.0:1789117506.564644:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385504256 00000100:00100000:3.0:1789117506.564646:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385504256 00000100:00100000:3.0:1789117506.564657:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385504384 00000100:00100000:3.0:1789117506.564659:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385504384 00000100:00100000:3.0:1789117506.564674:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789117506.564681:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+20:3298:x1876025385504000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789117506.564692:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117506.564705:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178149de00/0xf7565228e460dc72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7565228e460dc6b expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117506.564717:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117506.564747:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+19:3298:x1876025385504000:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117506.564754:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789117506.564768:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789117506.564774:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1785cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+18:3298:x1876025385504256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789117506.564781:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117506.564790:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c17c2044c00/0xf7565228e460deda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7565228e460ded3 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117506.564799:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117506.564830:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1785cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+17:3298:x1876025385504256:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117506.564845:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789117506.564890:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789117506.564895:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01ce580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+16:3301:x1876025385504384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789117506.564902:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117506.564910:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1781684600/0xf7565228e460d94d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7565228e460d946 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117506.564921:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117506.564945:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01ce580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:3301:x1876025385504384:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117506.564951:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789117506.564979:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385504256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789117506.564987:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385504000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789117506.565008:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385504384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117506.565092:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385503872:0@lo:9:umount.0 00000100:00100000:0.0:1789117506.565124:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117506.565144:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385504128:0@lo:9:umount.0 00000100:00100000:0.0:1789117506.565295:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117506.565326:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385503872 00000100:00100000:0.0:1789117506.565337:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385503872 00000100:00100000:0.0:1789117506.565374:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385504128 00000100:00100000:0.0:1789117506.565377:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385504128 00000100:00100000:0.0:1789117506.565396:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789117506.565425:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1876025385503872:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789117506.565448:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460dadc 00000100:00080000:0.0:1789117506.565585:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9c1681d67000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789117506.565713:0:13416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117506.565715:0:13416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1789117506.565751:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789117506.566069:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3297:x1876025385503872:12345-0@lo:9:umount.0 Request processed in 644us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117506.566076:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789117506.566091:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789117506.566099:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1876025385504128:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789117506.566113:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460dbc3 00000100:00080000:0.0:1789117506.566118:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9c17b7c56000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789117506.566151:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117506.566309:0:13416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1789117506.566388:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1789117506.566657:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3297:x1876025385504128:12345-0@lo:9:umount.0 Request processed in 558us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117506.566664:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1789117506.566690:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789117506.566694:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789117506.566709:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c1780031000/0xf7565228e460db92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460db99 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117506.566718:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1780031000 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:0.0:1789117506.566722:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c1780031000/0xf7565228e460db92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460db99 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117506.566730:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c1780031000/0xf7565228e460db92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7565228e460db99 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117506.566746:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c1780031000/0xf7565228e460db92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7565228e460db99 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117506.566751:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789117506.566754:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789117506.566756:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789117506.566783:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c1780031000/0xf7565228e460db92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460db99 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117506.566790:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117506.566828:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c1780031000/0xf7565228e460db92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460db99 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117506.566836:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c1780031000/0xf7565228e460db92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460db99 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117506.566852:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117506.566854:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117506.567078:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385504512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117506.567114:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117506.567269:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385504512 00000100:00100000:3.0:1789117506.567275:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385504512 00000100:00100000:3.0:1789117506.567312:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789117506.567321:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+15:3301:x1876025385504512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789117506.567330:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117506.567342:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1780030400/0xf7565228e460db99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7565228e460db92 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117506.567366:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117506.567397:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:3301:x1876025385504512:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117506.567442:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1789117506.567663:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117506.567755:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789117506.567786:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c16816b5000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789117506.567845:0:3297:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00100000:2.0:1789117506.567893:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3301:1876025385504512:0@lo:103:ldlm_bl.0 00000004:00080000:0.0:1789117506.567923:0:3297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789117506.567927:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385503872:0@lo:9:umount.0 00000100:00080000:0.0:1789117506.567945:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c16822f9000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789117506.567983:0:3297:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789117506.567991:0:3297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789117506.567994:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385504128:0@lo:9:umount.0 00000020:00080000:0.0:1789117506.575726:0:13415:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c17882d9a48) has no exports 00000020:00000080:0.0:1789117506.640016:0:13415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460d9a1 00000020:00000080:0.0:1789117506.640042:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c17c1c5e800/lustre-QMT0000_UUID 00000020:01000000:0.0:1789117506.640094:0:13415:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789117506.640179:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17c1c5e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789117506.640376:0:13415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789117506.640386:0:13415:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789117506.640391:0:13415:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9c17c1c64ed8) has no exports 00000020:00000080:2.0:1789117506.640907:0:13415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460d99a 00000020:00000080:2.0:1789117506.640915:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c17c1c5a800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789117506.640973:0:13415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789117506.640981:0:13415:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789117506.640983:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c17c1c5f800/lustre-QMT0000_UUID 00000020:00000080:2.0:1789117506.640987:0:13415:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17c1c5f800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789117506.640994:0:13415:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1789117506.641130:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17c1c5a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1789117507.397632:0:13416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117508.166019:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b8787c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385504768:0@lo:400:kworker.0 00000100:00100000:0.0:1789117508.166085:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117508.166141:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789117508.166148:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b8786580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385504640:0@lo:400:kworker.0 00000100:00100000:0.0:1789117508.166176:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117508.166213:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789117508.166222:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876025385504896:0@lo:400:kworker.0 00000100:00100000:0.0:1789117508.166252:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117508.166282:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385504768 00000100:00100000:0.0:1789117508.166289:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385504768 00000100:00100000:0.0:1789117508.166317:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385504896 00000100:00100000:0.0:1789117508.166321:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385504896 00000100:00100000:0.0:1789117508.166337:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789117508.166344:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0254f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1876025385504768:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789117508.166352:0:5841:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789117508.166389:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0254f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1876025385504768:12345-0@lo:400:kworker.0 Request processed in 43us (303us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789117508.166396:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789117508.166434:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789117508.166439:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0256d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1876025385504896:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789117508.166444:0:5841:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789117508.166473:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0256d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1876025385504896:12345-0@lo:400:kworker.0 Request processed in 31us (220us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789117508.166478:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1789117508.166508:0:3301:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789117508.166513:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9c16822fd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789117508.166525:0:3301:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1789117508.167667:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385504640 00000100:00100000:1.0:1789117508.167676:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385504640 00000100:00100000:1.0:1789117508.167740:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789117508.167749:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1783118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:3299:x1876025385504640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117508.167820:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1783118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8+14:3299:x1876025385504640:12345-0@lo:400:kworker.0 Request processed in 72us (1642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117508.167827:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789117508.167917:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b8786580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385504640:0@lo:400:kworker.0 00000100:00080000:1.0:1789117508.167931:0:3299:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789117508.167935:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9c1681d63000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789117508.167938:0:3299:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789117508.167942:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9c1681d63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789117508.167946:0:3299:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 161 00000100:00080000:1.0:1789117508.167951:0:3299:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c1681d63000 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:1.0:1789117508.167976:0:3299:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c17b85c0f00 x1876025385505024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789117508.168009:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b8787c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385504768:0@lo:400:kworker.0 00000100:00100000:1.0:1789117508.168046:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876025385505024:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789117508.168078:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117508.168108:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385505024 00000100:00100000:1.0:1789117508.168114:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385505024 00000100:00100000:1.0:1789117508.168135:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789117508.168139:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3297:x1876025385505024:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1789117508.168153:0:5840:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1789117508.198278:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9c16822fd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789117508.198287:0:3301:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 177 00000100:00080000:0.0:1789117508.198296:0:3301:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c16822fd800 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:0.0:1789117508.198332:0:3301:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c17c0255e00 x1876025385505152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789117508.198373:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876025385504896:0@lo:400:kworker.0 00000100:00100000:2.0:1789117508.199359:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0255e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876025385505152:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1789117508.199447:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117508.199861:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385505152 00000100:00100000:0.0:1789117508.199869:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385505152 00000100:00100000:0.0:1789117508.199905:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789117508.199912:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876025385505152:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1789117508.199926:0:5839:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789117508.199979:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876025385505152:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 67us (532us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789117508.199986:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1789117508.200098:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c16822fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789117508.200104:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789117508.200107:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0255e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876025385505152:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1789117508.228014:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3297:x1876025385505024:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 59865us (59927us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789117508.228028:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1789117508.228140:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c1681d63000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789117508.228145:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789117508.228149:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876025385505024:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1789117508.421553:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117509.445663:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789117509.808623:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789117509.808631:0:6713:0:(genops.c:885:class_export_put()) final put ffff9c1681d65800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789117509.808655:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1681d65800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789117509.808694:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c1681d67000 for lustre-OST0000 00000001:00100000:3.0:1789117509.814006:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789117509.814014:0:7650:0:(genops.c:885:class_export_put()) final put ffff9c17b7c50800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789117509.814156:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17b7c50800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789117509.814202:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c17b7c56000 for lustre-OST0001 00000001:00100000:2.0:1789117509.816272:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc 00000001:00080000:2.0:1789117509.816288:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1789117509.816306:0:5862:0:(genops.c:885:class_export_put()) final put ffff9c16816b6800/7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc 00000020:00000080:0.0:1789117509.816396:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c16816b6800/7a17a4b8-2f8f-4e94-9387-9a0b3ad8b4bc for lustre-MDT0000 00000020:00000080:0.0:1789117509.816463:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c16816b4800 for lustre-MDT0000 00010000:00010000:3.0:1789117510.469687:0:13416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117511.496858:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117512.517560:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789117512.709537:0:13415:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9c1788fa7780 - data ffff9c17a9ac76c0/ffff9c1681585400 00000020:01000000:2.0:1789117512.709664:0:13415:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9c1787d45d80 - data ffff9c17a9afc000/ffff9c17882e9400 00000001:00000004:2.0:1789117512.716544:0:13415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:0.0:1789117512.783166:0:13415:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789117512.783173:0:13415:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1789117512.783200:0:13415:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789117512.783202:0:13415:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789117512.784467:0:6991:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789117512.784472:0:6991:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1789117512.784483:0:6991:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789117512.785597:0:13415:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789117512.785602:0:13415:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1789117512.785617:0:13415:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789117512.785620:0:13415:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789117512.786945:0:8153:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789117512.786951:0:8153:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1789117512.786966:0:8153:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789117512.839798:0:13415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460d969 00000020:00000080:2.0:1789117512.839810:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c17c03a5800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789117512.840181:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17c03a5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789117512.841037:0:13415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460d97e 00000020:00000080:2.0:1789117512.841047:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c17c03a4800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789117512.841111:0:13415:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789117512.841119:0:13415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789117512.841127:0:13415:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789117512.841132:0:13415:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9c17882dced8) has no exports 00000004:01000000:2.0:1789117512.841294:0:13415:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789117512.841591:0:13415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460dbbc 00000020:00000080:2.0:1789117512.841597:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c16822f9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789117512.844048:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17c03a4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789117512.844202:0:13415:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789117512.844213:0:13415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789117512.844224:0:13415:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789117512.844229:0:13415:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9c178829b490) has no exports 00000020:00000080:2.0:1789117512.844236:0:13415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460dbb5 00000020:00000080:2.0:1789117512.844243:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c16822f8000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789117512.844373:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c16822f9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789117512.844382:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c16822f8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789117512.851260:0:13415:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789117512.851268:0:13415:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789117512.851271:0:13415:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1789117512.851279:0:13415:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789117512.851281:0:13415:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789117512.851804:0:13415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789117512.851817:0:13415:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789117512.851825:0:13415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460dad5 00000020:00000080:2.0:1789117512.851834:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c1784460800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789117512.858204:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c16822f9000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789117512.858221:0:8:0:(genops.c:885:class_export_put()) final put ffff9c16822fe000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789117512.858224:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c16822fe000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789117512.858233:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789117512.858603:0:13415:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789117512.858610:0:13415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789117512.858621:0:13415:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789117512.858625:0:13415:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9c1788299a48) has no exports 00000020:00000080:2.0:1789117512.858632:0:13415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460dace 00000020:00000080:2.0:1789117512.858639:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c16816b1800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789117512.859027:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1784460800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789117512.859036:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c16816b1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789117512.859368:0:13415:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789117512.859381:0:13415:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789117512.859385:0:13415:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1789117512.859391:0:13415:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789117512.859393:0:13415:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789117512.859446:0:13415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789117512.859454:0:13415:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789117512.859462:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c16816b5000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789117512.859470:0:8:0:(genops.c:885:class_export_put()) final put ffff9c16816b7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789117512.859473:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c16816b7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789117512.859479:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789117512.859486:0:13415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789117512.859491:0:13415:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789117512.859495:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c17b6966000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789117512.859498:0:13415:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17b6966000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789117512.859503:0:13415:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789117512.859840:0:13415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460d985 00000020:00000080:2.0:1789117512.859847:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c17c03a7800/lustre-MDD0000_UUID 00000020:01000000:2.0:1789117512.859865:0:13415:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1789117512.859869:0:13415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789117512.859873:0:13415:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789117512.859877:0:13415:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9c17882d8000) has no exports 00000020:00000080:2.0:1789117512.859902:0:13415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789117512.859906:0:13415:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1789117512.859910:0:13415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460d98c 00000020:00000080:2.0:1789117512.859914:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c17c03a2000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789117512.859923:0:13415:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c178548d000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1789117512.859927:0:13415:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c178548d000 3 00000020:01000004:2.0:1789117512.859929:0:13415:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c178548d000 from lustre-MDT0000 00000020:00000080:2.0:1789117512.859951:0:13415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789117512.859955:0:13415:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1789117512.859958:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c17c03a4000/lustre-MDT0000_UUID 00000020:00000080:2.0:1789117512.859961:0:13415:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17c03a4000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1789117512.859967:0:13415:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1789117512.859991:0:13415:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1789117512.859995:0:13415:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1789117512.859997:0:13415:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1789117512.860006:0:13415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789117512.860008:0:13415:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789117512.860014:0:13415:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9c1787c2d000 6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789117512.860019:0:13415:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9c17882d3490) has exports, disconnecting them 00000020:00080000:2.0:1789117512.860023:0:13415:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c1787c2d000), last request at 1789117296 00000020:00000080:2.0:1789117512.860037:0:13415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460d92a 00000020:00010000:2.0:1789117512.860040:0:13415:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c1787c2d000: total 2 00000100:00080000:2.0:1789117512.860058:0:13415:0:(import.c:65:import_set_state_nolock()) ffff9c1787c2b800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789117512.860076:0:13415:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c1787c2d000): rc 0 00000020:00080000:2.0:1789117512.860080:0:13415:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9c17882d3490) has no exports 00000020:00010000:3.0:1789117512.860189:0:13416:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c1787c2d000: total 2 00010000:00010000:3.0:1789117512.860217:0:13416:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c1787c2d000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1789117512.860256:0:13416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178149da00/0xf7565228e460dc3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7565228e460dc33 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117512.860270:0:13416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1780030200/0xf7565228e460dc2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7565228e460dc25 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117512.860280:0:13416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1780031a00/0xf7565228e460dc48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7565228e460dc41 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117512.860290:0:13416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1781684200/0xf7565228e460dc56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7565228e460dc4f expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117512.860312:0:13416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1787cbd400/0xf7565228e460debe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7565228e460deb7 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117512.860323:0:13416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c17c2045800/0xf7565228e460decc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7565228e460dec5 expref: 4 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117512.860335:0:13416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1781685a00/0xf7565228e460da42 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7565228e460da3b expref: 3 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117512.860345:0:13416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1780031200/0xf7565228e460dc80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7565228e460dc79 expref: 2 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117512.860354:0:13416:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c1787c2d000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1789117512.860365:0:13416:0:(genops.c:885:class_export_put()) final put ffff9c1787c2d000/6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8 00010000:00010000:3.0:1789117512.860371:0:13416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117512.860373:0:13416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117512.860375:0:13416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117512.860867:0:5833:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c17844b7400:5833] 0 exiting: rc = 1 00000100:00100000:3.0:1789117512.860978:0:5834:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c17844b7a00:5834] 1 exiting: rc = 0 00000020:00000080:0.0:1789117512.861277:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17c03a7800/lustre-MDD0000_UUID for lustre-MDD0000 00000100:00100000:1.0:1789117512.861281:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c1783160400:5835] 2 exiting: rc = 0 00000020:00000080:0.0:1789117512.861284:0:8:0:(genops.c:885:class_export_put()) final put ffff9c17c03a3000/lustre-MDD0000_UUID 00000020:00000080:0.0:1789117512.861288:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17c03a3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789117512.861295:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789117512.861802:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17c03a2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789117512.861809:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1787c2d000/6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8 for MGS 00000100:00100000:2.0:1789117512.861950:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.861961:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.861969:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.861977:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.861985:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.861994:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862002:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862009:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862017:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862026:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862035:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862044:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862053:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862061:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862069:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862079:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862089:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862113:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862122:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862127:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862134:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862139:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862154:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862160:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862166:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862172:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862177:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862183:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862190:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862196:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862201:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862207:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862212:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862218:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862223:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862228:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862234:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862239:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862245:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862250:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862255:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862260:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862266:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862271:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862276:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862287:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862292:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862306:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862311:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862316:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862322:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862326:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862331:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862336:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862341:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862346:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862352:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862364:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862369:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862374:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862379:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862383:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862388:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.862393:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1789117512.864828:0:13415:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789117512.864834:0:13415:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:0.0:1789117512.871154:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c1787c2b800 for MGS 00000020:01000000:2.0:1789117512.871328:0:13415:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9c17c01a77e0 - data ffff9c17a9bec948/ffff9c17bbcda400 00000020:01000000:2.0:1789117512.871461:0:13415:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9c178595ad20 - data ffff9c178208f000/ffff9c1798170000 00000020:00000080:2.0:1789117512.872015:0:13415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460d90e 00000020:00000080:2.0:1789117512.872023:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c1784db3000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789117512.872040:0:13415:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c178548d000 from MGS, refs=2 00000020:01000004:2.0:1789117512.872043:0:13415:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c178548d000 2 00000020:01000004:2.0:1789117512.872045:0:13415:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c178548d000 from MGS 00000020:00000080:2.0:1789117512.872064:0:13415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789117512.872069:0:13415:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1789117512.872072:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c178beb9000/MGS 00000020:00000080:2.0:1789117512.872074:0:13415:0:(genops.c:844:class_export_destroy()) destroying export ffff9c178beb9000/MGS for MGS 00000020:01000000:2.0:1789117512.872080:0:13415:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:0.0:1789117512.872118:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1784db3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789117512.872135:0:13415:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1789117512.872140:0:13415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789117512.872144:0:13415:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789117512.872151:0:13415:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c17a9769800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789117512.872156:0:13415:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9c178829ced8) has exports, disconnecting them 00000020:00080000:2.0:1789117512.872160:0:13415:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c17a9769800), last request at 1789117297 00000020:00000080:2.0:1789117512.872164:0:13415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460d9d9 00000020:00080000:2.0:1789117512.872173:0:13415:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c17a9769800): rc 0 00000020:00000080:2.0:1789117512.872177:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c17a9769800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789117512.872800:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17a9769800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1789117512.874453:0:13415:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1789117512.874468:0:13415:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789117512.874472:0:13415:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789117512.874478:0:13415:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789117512.874507:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c17a7c14800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789117512.874641:0:13415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789117512.874650:0:13415:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1789117512.874655:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c17a7c12000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789117512.874658:0:13415:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17a7c12000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789117512.874665:0:13415:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1789117512.874728:0:13415:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c178548d000 1 00000020:00000080:3.0:1789117512.874734:0:13415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460d900 00000020:00000080:3.0:1789117512.874739:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c1788023000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1789117512.874753:0:13415:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1789117512.874757:0:13415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789117512.874761:0:13415:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789117512.874764:0:13415:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9c17882d0000) has no exports 00000020:00000080:0.0:1789117512.874827:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1788023000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789117512.887841:0:13415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789117512.887854:0:13415:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789117512.887859:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c1798b5b800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789117512.887864:0:13415:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1798b5b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789117512.887873:0:13415:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789117512.888028:0:13415:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c1788ffc000 00000020:01000000:3.0:1789117512.888392:0:13415:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789117512.888396:0:13415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789117512.888416:0:13415:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789117512.888420:0:13415:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9c17882d1a48) has no exports 00000100:00100000:3.0:1789117512.888494:0:5841:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9c17ad3a9400:5841] 2 exiting: rc = 0 00000100:00100000:2.0:1789117512.888579:0:7242:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9c17b7984000:7242] 3 exiting: rc = 0 00000100:00100000:2.0:1789117512.888644:0:13177:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9c16820aec00:13177] 4 exiting: rc = 0 00000100:00100000:2.0:1789117512.889616:0:5840:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9c17b22efc00:5840] 1 exiting: rc = 0 00000100:00100000:2.0:1789117512.889703:0:5839:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9c17831fca00:5839] 0 exiting: rc = 1 00000100:00100000:3.0:1789117512.889827:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889836:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889843:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889849:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889859:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889869:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889883:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889888:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889893:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889909:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889914:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889919:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889924:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889929:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889934:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889941:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889950:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889955:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889960:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889969:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889974:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889979:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889984:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889989:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889993:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.889998:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890003:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890008:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890015:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890020:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890026:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890031:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890113:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890119:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890124:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890129:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890135:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890140:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890147:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890153:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890158:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890171:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890176:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890180:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890185:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890190:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890194:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890201:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890205:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890210:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890215:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890221:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890226:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890231:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890236:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890241:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890246:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890251:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890255:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890261:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890265:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890270:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890276:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.890280:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.894479:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9c17831fc400:5842] 0 exiting: rc = 1 00000100:00100000:0.0:1789117512.894687:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9c17ad3a9600:5843] 1 exiting: rc = 0 00000100:00100000:3.0:1789117512.895650:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.895660:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.895667:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.895675:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.895683:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.895690:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.895698:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.895705:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.895713:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.895721:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.895728:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.895736:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.895757:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.895764:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.895770:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.895789:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.895800:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.895811:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.895818:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.895823:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.895828:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896698:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896713:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896720:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896726:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896731:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896738:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896745:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896753:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896759:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896766:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896773:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896789:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896797:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896804:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896810:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896818:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896823:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896830:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896836:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896842:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896848:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896853:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896859:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896865:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896872:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896877:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896894:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896901:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896909:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896919:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896928:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896937:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896945:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896949:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896953:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896957:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896961:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896966:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896970:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896975:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896979:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896984:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.896989:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117512.898821:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9c17ad3a8200:5845] 1 exiting: rc = 0 00000100:00100000:3.0:1789117512.899003:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9c17ad3a9000:5844] 0 exiting: rc = 1 00000100:00100000:2.0:1789117512.899939:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.899949:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.899968:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.899977:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.899984:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.899990:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.899996:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900002:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900007:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900012:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900017:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900169:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900183:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900192:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900199:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900205:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900210:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900215:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900226:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900239:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900281:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900287:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900292:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900312:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900318:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900323:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900328:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900333:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900338:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900343:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900348:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900363:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900368:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900453:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900460:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900483:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900491:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900496:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900504:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900510:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900514:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900520:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900525:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900531:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900536:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900540:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900547:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900567:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900573:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900579:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900586:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900591:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900597:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.900602:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.901112:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.901122:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.901129:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.901135:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.901141:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.904254:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.904335:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.904341:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.904347:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.904361:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117512.922330:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9c178630b200:5846] 0 exiting: rc = 1 00000100:00100000:3.0:1789117512.922331:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9c178630a000:5847] 1 exiting: rc = 0 00000100:00100000:2.0:1789117512.922473:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922481:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922500:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922504:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922509:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922513:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922517:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922521:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922526:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922530:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922534:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922614:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922623:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922628:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922633:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922637:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922641:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922646:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922650:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922655:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922661:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922665:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922671:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922676:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922681:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922685:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922689:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922693:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922697:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922702:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922706:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922710:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922715:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922720:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922725:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922730:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922734:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922747:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922753:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922758:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922763:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922768:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922773:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922793:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922799:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922804:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922809:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922813:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922817:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922822:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922826:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922830:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922835:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922840:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922845:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922849:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922853:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922858:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922864:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922869:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922874:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922884:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922889:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.922894:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.923550:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9c179314c400:5849] 1 exiting: rc = 0 00000100:00100000:0.0:1789117512.923692:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9c1798a46200:5848] 0 exiting: rc = 1 00000100:00100000:2.0:1789117512.923830:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923837:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923847:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923854:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923864:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923872:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923878:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923883:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923903:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923908:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923912:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923917:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923921:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923926:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923931:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923937:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923942:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923947:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923953:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923963:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923968:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923973:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923978:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923984:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.923989:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924029:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924035:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924040:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924044:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924049:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924054:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924060:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924065:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924070:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924222:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924229:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924236:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924242:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924248:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924267:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924274:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924280:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924286:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924302:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924309:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924316:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924326:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924336:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924346:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924351:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924356:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924361:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924365:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924370:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924375:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924380:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924384:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924388:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924394:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924441:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924448:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924453:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924458:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.924463:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.924942:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9c17b6950200:5851] 1 exiting: rc = 0 00000100:00100000:0.0:1789117512.924959:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9c17b6950a00:5850] 0 exiting: rc = 1 00000100:00100000:2.0:1789117512.925033:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925039:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925043:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925048:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925053:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925058:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925063:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925069:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925308:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925316:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925321:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925327:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925332:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925337:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925351:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925355:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925360:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925364:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925369:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925373:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925377:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925382:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925387:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925392:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925397:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925423:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925430:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925437:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925445:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925450:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925455:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925461:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925466:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925471:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925476:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925481:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925486:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925491:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925496:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925500:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925505:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925510:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925515:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925520:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925525:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925529:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925534:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925580:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925589:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925600:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925605:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925610:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925626:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925631:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925638:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925642:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925647:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925651:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925655:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925660:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925664:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925668:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925673:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789117512.925677:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117512.926204:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9c17b6951c00:5853] 1 exiting: rc = 0 00000100:00100000:3.0:1789117512.926376:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9c17b6951000:5852] 0 exiting: rc = 1 00000100:00100000:2.0:1789117512.926859:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9c17afd86000:5854] 2 exiting: rc = 0 00000100:00100000:3.0:1789117512.926957:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.926963:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.926969:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.926976:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.926981:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.926986:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.926991:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.926997:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927002:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927008:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927013:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927018:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927036:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927043:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927049:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927055:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927060:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927066:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927072:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927079:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927085:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927093:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927100:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927107:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927114:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927121:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927140:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927170:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927179:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927186:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927193:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927200:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927208:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927214:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927219:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927225:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927232:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927240:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927248:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927256:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927264:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927274:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927284:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927290:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927295:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927300:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927304:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927322:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927327:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927332:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927337:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927358:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927364:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927368:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927371:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927374:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927378:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927381:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927385:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927388:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927391:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927394:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927414:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117512.927428:0:13415:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789117512.931898:0:13415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789117512.931909:0:13415:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789117512.931915:0:13415:0:(genops.c:885:class_export_put()) final put ffff9c1785d9b800/MDS_uuid 00000020:00000080:3.0:1789117512.931919:0:13415:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1785d9b800/MDS_uuid for MDS 00000020:01000000:3.0:1789117512.931924:0:13415:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789117512.932033:0:13415:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:0.0:1789117513.285695:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789117513.285701:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789117513.285704:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c1681d63000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789117513.285712:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 355 00000100:00080000:0.0:1789117513.285717:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789117513.285723:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c1681d63000 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:0.0:1789117513.285745:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c17c0257840 x1876025385505408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789117513.285763:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789117513.285766:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789117513.285768:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c16822fd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789117513.285771:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 355 00000100:00080000:0.0:1789117513.285773:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789117513.285801:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c16822fd800 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:0.0:1789117513.285814:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c17c02561c0 x1876025385505536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789117513.286038:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0257840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876025385505408:0@lo:38:kworker.0 00000100:00100000:1.0:1789117513.286239:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117513.286390:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0255a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385505280:0@lo:400:kworker.0 00000400:00000100:1.0:1789117513.286626:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876025385505280 offset 0 length 224: 4 00000400:00000100:3.0:1789117513.286938:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025385505408 offset 0 length 520: 4 00000100:00100000:3.0:1789117513.286962:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876025385505536:0@lo:38:kworker.0 00000400:00000100:3.0:1789117513.286983:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025385505536 offset 0 length 520: 4 00010000:00010000:1.0:1789117513.546489:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117514.566935:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789117515.384859:0:13571:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789117515.403867:0:13571:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789117515.403913:0:13571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e000/0xf7565228e460dc41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc48 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117515.403926:0:13571:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e000/0xf7565228e460dc41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dc48 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117515.403933:0:13571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e000/0xf7565228e460dc41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460dc48 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117515.403939:0:13571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.137@tcp lock: ffff9c178457e000/0xf7565228e460dc41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460dc48 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117515.403964:0:13571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789117515.403969:0:13571:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789117515.403991:0:13571:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789117515.404013:0:13571:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c17c0257840 x1876025385505408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789117528 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117515.404033:0:13571:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789117515.404039:0:13571:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789117515.404044:0:13571:0:(import.c:65:import_set_state_nolock()) ffff9c1681d63000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789117515.404049:0:13571:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789117515.404052:0:13571:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c17c0257840 x1876025385505408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789117528 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117515.404059:0:13571:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789117515.404061:0:13571:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:1.0:1789117515.404108:0:13416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117515.404116:0:13416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c178457e000/0xf7565228e460dc41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460dc48 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117515.404123:0:13416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e000 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:1.0:1789117515.404127:0:13416:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c178457e000/0xf7565228e460dc41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460dc48 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117515.404136:0:13416:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178457e000/0xf7565228e460dc41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7565228e460dc48 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117515.404143:0:13416:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178457e000/0xf7565228e460dc41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7565228e460dc48 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117515.404155:0:13416:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789117515.404157:0:13416:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789117515.404159:0:13416:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789117515.404196:0:13416:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c178457e000/0xf7565228e460dc41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460dc48 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117515.404203:0:13416:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117515.404242:0:13416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c178457e000/0xf7565228e460dc41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460dc48 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117515.404249:0:13416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178457e000/0xf7565228e460dc41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460dc48 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117515.404260:0:13416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117515.404262:0:13416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117515.404263:0:13416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117515.404271:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117515.404285:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385505664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117515.404346:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117515.404431:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385505664 00000100:00100000:1.0:1789117515.404438:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385505664 00000100:00100000:1.0:1789117515.404475:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789117515.404482:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3299:x1876025385505664:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789117515.404488:0:5826:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789117515 with bad export cookie 17822522910949038378 00000100:00100000:3.0:1789117515.406464:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0257840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876025385505408:0@lo:38:kworker.0 00010000:00010000:2.0:1789117515.407803:0:13571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457ee00/0xf7565228e460dc4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc56 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117515.407818:0:13571:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457ee00/0xf7565228e460dc4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dc56 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117515.407824:0:13571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457ee00/0xf7565228e460dc4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460dc56 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117515.407830:0:13571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.137@tcp lock: ffff9c178457ee00/0xf7565228e460dc4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460dc56 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117515.407849:0:13571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117515.407855:0:13571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460dec5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460decc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117515.407862:0:13571:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460dec5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460decc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117515.407868:0:13571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460dec5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460decc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117515.407886:0:13571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460dec5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460decc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117515.407897:0:13571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789117515.407902:0:13571:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789117515.407926:0:13571:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789117515.407930:0:13571:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789117515.407934:0:13571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789117515.407938:0:13571:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789117515.407942:0:13571:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9c16816eb490) has no exports 00000020:00080000:2.0:1789117515.408112:0:13571:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9c16816eb490) has no exports 00000020:01000000:2.0:1789117515.409690:0:13571:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9c17861a0d20 - data ffff9c17a9ad1e58/ffff9c168337b400 00000020:01000000:3.0:1789117515.409856:0:13571:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9c178593d900 - data ffff9c17a98466c0/ffff9c1681ec1c00 00010000:00010000:0.0:1789117515.411173:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789117515.411185:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c178457ee00/0xf7565228e460dc4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460dc56 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117515.411196:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457ee00 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:0.0:1789117515.411201:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c178457ee00/0xf7565228e460dc4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460dc56 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117515.411211:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178457ee00/0xf7565228e460dc4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7565228e460dc56 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117515.411219:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178457ee00/0xf7565228e460dc4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7565228e460dc56 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117515.411225:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789117515.411228:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1789117515.411231:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1789117515.411271:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c178457ee00/0xf7565228e460dc4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460dc56 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117515.411277:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117515.411307:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c178457ee00/0xf7565228e460dc4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460dc56 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117515.411314:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178457ee00/0xf7565228e460dc4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460dc56 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117515.411342:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117515.411346:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460dec5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460decc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117515.411351:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2045e00 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:0.0:1789117515.411355:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460dec5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460decc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117515.411361:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460dec5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7565228e460decc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117515.411368:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460dec5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7565228e460decc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117515.411373:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789117515.411376:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789117515.411378:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789117515.411393:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460dec5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460decc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117515.414260:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117515.414290:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460dec5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460decc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117515.414300:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c17c2045e00/0xf7565228e460dec5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7565228e460decc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117515.414323:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117515.414325:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117515.414341:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117515.414531:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117515.414553:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385505792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117515.414618:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117515.414669:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0256580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385505920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117515.414694:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117515.414730:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385505792 00000100:00100000:2.0:1789117515.414737:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385505792 00000100:00100000:2.0:1789117515.414776:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385505920 00000100:00100000:2.0:1789117515.414779:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385505920 00000100:00100000:2.0:1789117515.414793:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789117515.414800:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3298:x1876025385505792:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789117515.414806:0:5825:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789117515 with bad export cookie 17822522910949038378 00000100:00100000:2.0:1789117515.414849:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3298:x1876025385505792:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (230us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789117515.414856:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789117515.414879:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789117515.414883:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3300:x1876025385505920:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789117515.414887:0:5825:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789117515 with bad export cookie 17822522910949038378 00000100:00100000:2.0:1789117515.414917:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3300:x1876025385505920:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (222us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789117515.414922:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1789117515.414955:0:3300:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.137@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789117515.414959:0:3300:0:(import.c:65:import_set_state_nolock()) ffff9c1785d9f000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789117515.414963:0:3300:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.137@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1789117515.415602:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789117515.417521:0:3298:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.137@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1789117515.420834:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3299:x1876025385505664:12345-0@lo:103:ldlm_bl.0 Request processed in 16347us (16483us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789117515.420847:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789117515.420898:0:3299:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.137@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789117515.433915:0:3300:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.137@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789117515.433921:0:3300:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789117515.433930:0:3300:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c17c0255a40 x1876025385505280/t0(0) o400->MGC192.168.206.137@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789117529 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117515.433944:0:3300:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c17b85c3c00 x1876025385505664/t0(0) o103->MGC192.168.206.137@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789117531 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117515.433954:0:3300:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c17c02543c0 x1876025385505792/t0(0) o103->MGC192.168.206.137@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789117531 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117515.433963:0:3300:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c17c0256580 x1876025385505920/t0(0) o103->MGC192.168.206.137@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789117531 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789117515.433971:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789117515.433974:0:3300:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789117515.433976:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789117515.437893:0:3298:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c1785d9f000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1789117515.437921:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3298:1876025385505792:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789117515.444019:0:3299:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c1785d9f000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1789117515.444047:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3299:1876025385505664:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789117515.444488:0:3300:0:(import.c:65:import_set_state_nolock()) ffff9c1785d9f000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789117515.444495:0:3300:0:(import.c:510:import_select_connection()) MGC192.168.206.137@tcp: connect to NID 0@lo last attempt 143 00000100:00080000:2.0:1789117515.444503:0:3300:0:(import.c:624:import_select_connection()) MGC192.168.206.137@tcp: import ffff9c1785d9f000 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:2.0:1789117515.444533:0:3300:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c17b87e83c0 x1876025385506048/t0(0) o250->MGC192.168.206.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789117515.444585:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3297:1876025385506048:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1789117515.444646:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876025385506048 offset 0 length 520: 4 00000100:00100000:2.0:1789117515.444733:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0255a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385505280:0@lo:400:kworker.0 00000100:00100000:2.0:1789117515.444758:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0256580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3300:1876025385505920:0@lo:103:ldlm_bl.0 00100000:10000000:3.0:1789117515.460807:0:13571:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789117515.581648:0:13571:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460da5e 00000020:00000080:0.0:1789117515.581658:0:13571:0:(genops.c:885:class_export_put()) final put ffff9c16816f5800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789117515.581680:0:13571:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c17c03a3800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789117515.581683:0:13571:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c17c03a3800 2 00000020:01000004:0.0:1789117515.581686:0:13571:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c17c03a3800 from lustre-OST0000 00000020:00000080:0.0:1789117515.581710:0:13571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789117515.581718:0:13571:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789117515.581721:0:13571:0:(genops.c:885:class_export_put()) final put ffff9c1784460000/lustre-OST0000_UUID 00000020:00000080:0.0:1789117515.581725:0:13571:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1784460000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789117515.581730:0:13571:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789117515.581779:0:13571:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789117515.581784:0:13571:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789117515.581787:0:13571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789117515.581791:0:13571:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789117515.581797:0:13571:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9c1681d64800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789117515.581803:0:13571:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9c17c1c60000) has exports, disconnecting them 00000020:00080000:0.0:1789117515.581807:0:13571:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9c1681d64800), last request at 1789117314 00000020:00000080:0.0:1789117515.581812:0:13571:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460da88 00000020:00080000:0.0:1789117515.581821:0:13571:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c1681d64800): rc 0 00000020:00000080:0.0:1789117515.581826:0:13571:0:(genops.c:885:class_export_put()) final put ffff9c1681d64800/lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789117515.582338:0:13571:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789117515.582343:0:13571:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789117515.582346:0:13571:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789117515.582351:0:13571:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789117515.582531:0:13571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789117515.582536:0:13571:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1789117515.582540:0:13571:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c17c03a3800 1 00000020:00000080:0.0:1789117515.582544:0:13571:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460da18 00000020:00000080:0.0:1789117515.582549:0:13571:0:(genops.c:885:class_export_put()) final put ffff9c17b78cc000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789117515.582553:0:13571:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789117515.582556:0:13571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789117515.582558:0:13571:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789117515.582561:0:13571:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9c17882db490) has no exports 00000020:00000080:3.0:1789117515.582668:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c16816f5800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789117515.582679:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1681d64800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789117515.582684:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c1681d63000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789117515.582689:0:8:0:(genops.c:885:class_export_put()) final put ffff9c17b78ca800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789117515.582691:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17b78ca800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789117515.582695:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789117515.582731:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17b78cc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789117515.605932:0:13571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789117515.605945:0:13571:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789117515.605949:0:13571:0:(genops.c:885:class_export_put()) final put ffff9c17c03a1800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789117515.605953:0:13571:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17c03a1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789117515.605959:0:13571:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789117515.606070:0:13571:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c17c03a2800 00000020:02000400:1.0:1789117515.606129:0:13571:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789117515.854443:0:13416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117516.870274:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117517.900561:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789117518.405711:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789117518.405721:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789117518.405723:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789117518.405726:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:0.0:1789117518.524998:0:13721:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1789117518.547536:0:13721:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789117518.547614:0:13721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457ea00/0xf7565228e460dc25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc2c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117518.547629:0:13721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457ea00/0xf7565228e460dc25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dc2c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117518.547645:0:13721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457ea00/0xf7565228e460dc25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460dc2c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117518.547654:0:13721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.137@tcp lock: ffff9c178457ea00/0xf7565228e460dc25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460dc2c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117518.547676:0:13721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789117518.547681:0:13721:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789117518.547701:0:13721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789117518.547711:0:13721:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c17c02561c0 x1876025385505536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789117528 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117518.547734:0:13721:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789117518.547739:0:13721:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789117518.547763:0:13721:0:(import.c:65:import_set_state_nolock()) ffff9c16822fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789117518.547768:0:13721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789117518.547772:0:13721:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c17c02561c0 x1876025385505536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789117528 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117518.547779:0:13721:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789117518.547782:0:13721:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00010000:00010000:1.0:1789117518.550149:0:13416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117518.550162:0:13416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c178457ea00/0xf7565228e460dc25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460dc2c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117518.550174:0:13416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457ea00 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:1.0:1789117518.550178:0:13416:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c178457ea00/0xf7565228e460dc25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460dc2c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117518.550188:0:13416:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178457ea00/0xf7565228e460dc25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7565228e460dc2c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117518.550196:0:13416:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178457ea00/0xf7565228e460dc25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7565228e460dc2c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117518.550221:0:13416:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789117518.550224:0:13416:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789117518.550227:0:13416:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789117518.550253:0:13416:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c1785d9f000 00010000:00010000:1.0:1789117518.550258:0:13416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c178457ea00/0xf7565228e460dc25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7565228e460dc2c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117518.550264:0:13416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178457ea00/0xf7565228e460dc25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7565228e460dc2c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117518.550277:0:13416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117518.550279:0:13416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117518.550281:0:13416:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117518.550314:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876025385505536:0@lo:38:kworker.0 00010000:00010000:1.0:1789117518.553893:0:13721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e200/0xf7565228e460dc33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460dc3a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117518.553911:0:13721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e200/0xf7565228e460dc33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460dc3a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117518.553918:0:13721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e200/0xf7565228e460dc33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460dc3a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117518.553925:0:13721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.137@tcp lock: ffff9c178457e200/0xf7565228e460dc33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460dc3a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117518.553946:0:13721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789117518.553953:0:13721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460deb7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460debe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117518.553975:0:13721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460deb7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460debe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117518.553981:0:13721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460deb7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460debe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117518.553986:0:13721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460deb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7565228e460debe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117518.554007:0:13721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789117518.554012:0:13721:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789117518.554032:0:13721:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789117518.554036:0:13721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789117518.554040:0:13721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789117518.554046:0:13721:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789117518.554050:0:13721:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9c17c1c63490) has no exports 00010000:00010000:2.0:1789117518.554145:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789117518.554152:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c178457e200/0xf7565228e460dc33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460dc3a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117518.554159:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e200 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:2.0:1789117518.554163:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c178457e200/0xf7565228e460dc33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460dc3a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117518.554170:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178457e200/0xf7565228e460dc33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7565228e460dc3a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117518.554176:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178457e200/0xf7565228e460dc33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7565228e460dc3a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117518.554181:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789117518.554183:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1789117518.554185:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1789117518.554197:0:5828:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c1785d9f000 00010000:00010000:2.0:1789117518.554201:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c178457e200/0xf7565228e460dc33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7565228e460dc3a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117518.554206:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178457e200/0xf7565228e460dc33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7565228e460dc3a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117518.554218:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117518.554221:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460deb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460debe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117518.554238:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f400 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:2.0:1789117518.554241:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460deb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7565228e460debe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117518.554257:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460deb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7565228e460debe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117518.554263:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460deb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7565228e460debe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117518.554268:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789117518.554270:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789117518.554271:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789117518.554277:0:5828:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c1785d9f000 00010000:00010000:2.0:1789117518.554280:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460deb7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7565228e460debe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117518.554287:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460deb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7565228e460debe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117518.554299:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117518.554300:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117518.554302:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789117518.554598:0:13721:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9c17c1c63490) has no exports 00010000:00010000:0.0:1789117518.554738:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789117518.558850:0:13721:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9c17861a0720 - data ffff9c17a9ad11b0/ffff9c1683379400 00000020:01000000:1.0:1789117518.559007:0:13721:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9c17883e7060 - data ffff9c17bfc220d8/ffff9c17b86a2400 00100000:10000000:0.0:1789117518.591924:0:13721:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789117518.710930:0:13721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460db29 00000020:00000080:0.0:1789117518.710941:0:13721:0:(genops.c:885:class_export_put()) final put ffff9c17b86dc000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789117518.710963:0:13721:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c16816f2800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789117518.710966:0:13721:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c16816f2800 2 00000020:01000004:0.0:1789117518.710970:0:13721:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c16816f2800 from lustre-OST0001 00000020:00000080:0.0:1789117518.710992:0:13721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789117518.711002:0:13721:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789117518.711004:0:13721:0:(genops.c:885:class_export_put()) final put ffff9c17b86dd000/lustre-OST0001_UUID 00000020:00000080:0.0:1789117518.711007:0:13721:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17b86dd000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789117518.711013:0:13721:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789117518.711130:0:13721:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8->MGS 00010000:00010000:0.0:1789117518.711148:0:13721:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178149c400/0xf7565228e460da3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7565228e460da42 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117518.711159:0:13721:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178149c400/0xf7565228e460da3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7565228e460da42 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117518.711166:0:13721:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789117518.711169:0:13721:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789117518.711172:0:13721:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789117518.711186:0:13721:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c1785d9f000 00010000:00010000:0.0:1789117518.711190:0:13721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178149c400/0xf7565228e460da3b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7565228e460da42 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117518.711214:0:13721:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c1781685000/0xf7565228e460dc79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7565228e460dc80 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117518.711221:0:13721:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c1781685000/0xf7565228e460dc79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7565228e460dc80 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117518.711227:0:13721:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789117518.711229:0:13721:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789117518.711230:0:13721:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789117518.711239:0:13721:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c1785d9f000 00010000:00010000:0.0:1789117518.711242:0:13721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c1781685000/0xf7565228e460dc79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7565228e460dc80 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789117518.711259:0:13721:0:(import.c:65:import_set_state_nolock()) ffff9c1785d9f000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789117518.711263:0:13721:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789117518.711265:0:13721:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789117518.711267:0:13721:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789117518.711270:0:13721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789117518.711280:0:13721:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c17b87e83c0 x1876025385506048/t0(0) o250->MGC192.168.206.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789117525 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789117518.711299:0:13721:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789117518.711301:0:13721:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1789117518.711334:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8:3297:1876025385506048:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:0.0:1789117518.711365:0:13721:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789117518.711371:0:13721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460d91c 00000020:00000080:0.0:1789117518.711376:0:13721:0:(genops.c:885:class_export_put()) final put ffff9c1785d9e800/6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8 00000020:01000000:0.0:1789117518.711382:0:13721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.137@tcp (flags='') 00000020:00000080:0.0:1789117518.711387:0:13721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789117518.711391:0:13721:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.137@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789117518.712029:0:13721:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9c17882d4ed8) has no exports 10000000:01000000:0.0:1789117518.712053:0:5837:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789117518.712114:0:13721:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.206.137@tcp: client import never connected 00000100:00080000:0.0:1789117518.712116:0:13721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789117518.712119:0:13721:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789117518.712121:0:13721:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789117518.712122:0:13721:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789117518.712153:0:13721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789117518.712158:0:13721:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.137@tcp (uuid 6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8) 00000020:01000000:0.0:1789117518.712163:0:13721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789117518.712166:0:13721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789117518.712170:0:13721:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789117518.712175:0:13721:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9c16822fb000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789117518.712180:0:13721:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9c1788298000) has exports, disconnecting them 00000020:00080000:0.0:1789117518.712184:0:13721:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9c16822fb000), last request at 1789117330 00000020:00000080:0.0:1789117518.712187:0:13721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460db53 00000020:00080000:0.0:1789117518.712199:0:13721:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c16822fb000): rc 0 00000020:00000080:0.0:1789117518.712202:0:13721:0:(genops.c:885:class_export_put()) final put ffff9c16822fb000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789117518.713014:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17b86dc000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789117518.713030:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1785d9e800/6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8 for MGC192.168.206.137@tcp 00000020:00000080:3.0:1789117518.713037:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c1785d9f000 for MGC192.168.206.137@tcp 00000020:00000080:3.0:1789117518.713043:0:36:0:(genops.c:885:class_export_put()) final put ffff9c1785d9c800/6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8 00000020:00000080:3.0:1789117518.713046:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1785d9c800/6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8 for MGC192.168.206.137@tcp 00000020:01000000:3.0:1789117518.713050:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.137@tcp (6890fac5-a1a1-4c91-b9bf-0d4ba4db4de8) 00000020:00000080:3.0:1789117518.713296:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c16822fb000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789117518.713957:0:13721:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789117518.713962:0:13721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789117518.713966:0:13721:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789117518.713971:0:13721:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789117518.714034:0:13416:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1789117518.714146:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c16822fd800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1789117518.715262:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1789117518.716033:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1789117518.717248:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9c17844b7800:5824] 1 exiting: rc = 0 00000100:00100000:1.0:1789117518.717677:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9c1787d2ba00:5823] 0 exiting: rc = 1 00000100:00100000:3.0:1789117518.717849:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.718192:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9c17844b6800:5825] 0 exiting: rc = 1 00000100:00100000:3.0:1789117518.718551:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9c17844b6200:5827] 2 exiting: rc = 0 00000100:00100000:2.0:1789117518.718816:0:7638:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9c178528b600:7638] 3 exiting: rc = 0 00000100:00100000:1.0:1789117518.722538:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9c17844b6a00:5826] 1 exiting: rc = 0 00000100:00100000:3.0:1789117518.722683:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722691:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722698:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722704:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722717:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722754:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722761:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722766:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722772:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722777:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722783:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722789:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722794:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722799:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722805:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722810:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722816:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722822:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722828:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722833:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722838:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722843:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722848:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722853:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722858:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722863:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722868:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722873:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722879:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722884:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722889:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722893:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722898:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722903:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722908:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722913:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722918:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722922:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722927:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722932:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722944:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722949:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722954:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722959:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722964:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722968:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722973:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722978:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722983:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722988:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722992:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.722997:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.723002:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.723007:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.723012:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.723016:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.723021:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.723026:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.723032:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.723037:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.723042:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.723046:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.723051:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.723056:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789117518.724056:0:13721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789117518.724125:0:13721:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789117518.724131:0:13721:0:(genops.c:885:class_export_put()) final put ffff9c16816b3000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789117518.724136:0:13721:0:(genops.c:844:class_export_destroy()) destroying export ffff9c16816b3000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789117518.724141:0:13721:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1789117518.724177:0:13721:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c16816f2800 1 00000020:00000080:3.0:1789117518.724182:0:13721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf7565228e460daf8 00000020:00000080:3.0:1789117518.724188:0:13721:0:(genops.c:885:class_export_put()) final put ffff9c17bbce3000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789117518.724238:0:13721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789117518.724243:0:13721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789117518.724255:0:13721:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789117518.724259:0:13721:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9c16816eced8) has no exports 00000020:00000080:1.0:1789117518.724579:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17bbce3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789117518.747199:0:13721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789117518.747214:0:13721:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789117518.747219:0:13721:0:(genops.c:885:class_export_put()) final put ffff9c16816f1800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789117518.747223:0:13721:0:(genops.c:844:class_export_destroy()) destroying export ffff9c16816f1800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789117518.747233:0:13721:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789117518.748077:0:13721:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c16816f4000 00000020:01000000:1.0:1789117518.748101:0:13721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789117518.748104:0:13721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789117518.748108:0:13721:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789117518.748111:0:13721:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9c17c1c61a48) has no exports 00000020:00000080:1.0:1789117518.748135:0:13721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789117518.748141:0:13721:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789117518.748144:0:13721:0:(genops.c:885:class_export_put()) final put ffff9c17b78cf800/OSS_uuid 00000020:00000080:1.0:1789117518.748147:0:13721:0:(genops.c:844:class_export_destroy()) destroying export ffff9c17b78cf800/OSS_uuid for OSS 00000020:01000000:1.0:1789117518.748150:0:13721:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1789117518.748281:0:5836:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789117518.748421:0:8269:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9c17b8671000:8269] 3 exiting: rc = 0 00000100:00100000:0.0:1789117518.748472:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9c1784554800:6687] 2 exiting: rc = 0 00000100:00100000:0.0:1789117518.748529:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9c17c1d23a00:6685] 0 exiting: rc = 1 00000100:00100000:0.0:1789117518.748586:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9c1784555400:6686] 1 exiting: rc = 0 00000100:00100000:1.0:1789117518.749217:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749226:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749233:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749240:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749245:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749250:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749254:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749260:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749264:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749269:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749274:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749279:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749283:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749289:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749294:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749299:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749304:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749309:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749313:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749318:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749322:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749327:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749332:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749338:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749343:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749361:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749367:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749372:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749377:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749383:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749389:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749394:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749429:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749435:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749440:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749445:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749449:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749453:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749458:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749463:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749468:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749473:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749478:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749483:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749487:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749493:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749497:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749502:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749510:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749515:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749519:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749524:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749528:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749532:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749537:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749542:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749546:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749552:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749663:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749669:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749683:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749688:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749693:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.749699:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117518.751100:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9c17c1d22600:6689] 1 exiting: rc = 0 00000100:00100000:0.0:1789117518.751186:0:13326:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9c1683207c00:13326] 2 exiting: rc = 0 00000100:00100000:3.0:1789117518.767806:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9c1784555000:6688] 0 exiting: rc = 1 00000100:00100000:1.0:1789117518.768135:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768146:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768152:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768157:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768161:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768167:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768172:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768178:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768183:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768188:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768194:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768200:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768205:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768210:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768215:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768221:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768226:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768231:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768237:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768241:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768246:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768252:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768257:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768262:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768266:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768271:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768276:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768281:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768287:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768292:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768297:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768316:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768321:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768326:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768331:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768336:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768341:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768346:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768352:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768356:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768360:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768365:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768369:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768374:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768378:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768383:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768388:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768393:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768802:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768811:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768816:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768821:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768826:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768831:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768836:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768842:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768847:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768853:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768858:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768866:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768872:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768877:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768882:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.768888:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117518.771208:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9c17b7918800:6692] 2 exiting: rc = 0 00000100:00100000:2.0:1789117518.771537:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9c17b7919800:6690] 0 exiting: rc = 1 00000100:00100000:3.0:1789117518.771885:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9c17b7918e00:6691] 1 exiting: rc = 0 00000100:00100000:1.0:1789117518.772365:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.772373:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.772390:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.772396:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.772911:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.772916:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.772921:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.772926:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.772932:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.772937:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.772943:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.772947:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.772953:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.772958:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.772963:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.772969:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.772975:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.772981:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.772986:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.772990:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.772995:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773000:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773005:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773010:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773032:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773039:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773044:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773049:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773055:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773060:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773180:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773186:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773193:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773199:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773204:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773209:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773213:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773228:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773233:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773238:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773244:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773249:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773255:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773260:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773265:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773271:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773276:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773281:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773301:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773307:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773313:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773318:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773323:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773329:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773335:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773341:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773346:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773351:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773356:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773361:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773367:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773372:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773377:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.773383:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789117518.780040:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9c17b7918200:6693] 0 exiting: rc = 1 00000100:00100000:3.0:1789117518.780952:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9c17b7919600:6694] 1 exiting: rc = 0 00000100:00100000:1.0:1789117518.781841:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781849:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781854:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781859:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781864:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781868:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781873:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781877:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781898:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781902:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781908:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781914:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781918:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781923:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781929:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781935:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781940:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781944:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781949:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781953:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781958:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781963:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781969:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781974:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781979:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781983:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781988:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781993:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.781998:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782003:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782008:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782014:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782019:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782024:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782029:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782034:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782039:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782044:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782048:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782053:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782058:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782139:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782145:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782158:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782163:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782168:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782173:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782178:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782183:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782187:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782193:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782198:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782203:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782208:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782213:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782217:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782223:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782227:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782232:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782237:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782242:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782247:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782253:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789117518.782259:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.784177:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9c17c0a9d000:6696] 1 exiting: rc = 0 00000100:00100000:0.0:1789117518.789027:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9c17c0a9dc00:6695] 0 exiting: rc = 1 00000100:00100000:3.0:1789117518.791511:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791523:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791529:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791534:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791541:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791546:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791552:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791559:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791585:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791593:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791609:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791618:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791624:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791630:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791636:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791642:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791647:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791653:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791658:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791664:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791687:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791694:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791700:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791706:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791711:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791716:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791721:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791728:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791758:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791765:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791770:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791775:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791793:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791800:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791807:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791817:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791823:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791829:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791834:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791840:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791846:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791851:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791861:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791866:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791887:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791895:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791901:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791906:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791913:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791919:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791925:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791931:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791937:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791943:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791949:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791954:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791975:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791982:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791988:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791993:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.791999:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.792004:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.792009:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789117518.792022:0:13721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789117518.804962:0:13721:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789117536.393528:0:14339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg637-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789117544.982798:0:14799:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789117544.982803:0:14799:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789117544.982957:0:14799:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c1683d8b800 00000020:01000004:0.0:1789117544.982973:0:14799:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789117544.982981:0:14799:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789117544.982993:0:14799:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c1788299a48) 00000020:00000080:0.0:1789117544.983005:0:14799:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789117544.997369:0:14799:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789117545.001761:0:14799:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1789117545.002096:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 237: rc = 0 00100000:10000000:1.0:1789117545.002191:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 237: rc = 0 00100000:10000000:1.0:1789117545.002286:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 237: rc = 0 00100000:10000000:1.0:1789117545.002380:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 237: rc = 0 00100000:10000000:1.0:1789117545.002582:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 237: rc = 0 00100000:10000000:1.0:1789117545.002864:0:14799:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789117545.002908:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 237: rc = 0 00100000:10000000:1.0:1789117545.003153:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 239: rc = 0 00100000:10000000:1.0:1789117545.004829:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 513: rc = 0 00100000:10000000:1.0:1789117545.004974:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 513: rc = 0 00100000:10000000:1.0:1789117545.005366:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 519: rc = 0 00100000:10000000:1.0:1789117545.005882:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 519: rc = 0 00100000:10000000:1.0:1789117545.006369:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 519: rc = 0 00100000:10000000:1.0:1789117545.006895:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 519: rc = 0 00100000:10000000:1.0:1789117545.007144:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 519: rc = 0 00100000:10000000:1.0:1789117545.007391:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 519: rc = 0 00100000:10000000:1.0:1789117545.007895:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 519: rc = 0 00100000:10000000:1.0:1789117545.008138:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 519: rc = 0 00100000:10000000:1.0:1789117545.008461:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 519: rc = 0 00100000:10000000:1.0:1789117545.008932:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 519: rc = 0 00100000:10000000:1.0:1789117545.009202:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 519: rc = 0 00100000:10000000:1.0:1789117545.009481:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 519: rc = 0 00100000:10000000:1.0:1789117545.010126:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 774: rc = 0 00100000:10000000:1.0:1789117545.010367:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 774: rc = 0 00100000:10000000:1.0:1789117545.010877:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 774: rc = 0 00100000:10000000:1.0:1789117545.011108:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 774: rc = 0 00100000:10000000:1.0:1789117545.011319:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 774: rc = 0 00100000:10000000:1.0:1789117545.011777:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 774: rc = 0 00100000:10000000:1.0:1789117545.012088:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 774: rc = 0 00100000:10000000:1.0:1789117545.012292:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 774: rc = 0 00100000:10000000:1.0:1789117545.012597:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 774: rc = 0 00100000:10000000:1.0:1789117545.012876:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 774: rc = 0 00100000:10000000:1.0:1789117545.013101:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 774: rc = 0 00100000:10000000:1.0:1789117545.013314:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 774: rc = 0 00100000:10000000:1.0:1789117545.013830:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 774: rc = 0 00100000:10000000:1.0:1789117545.014097:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 774: rc = 0 00100000:10000000:1.0:1789117545.014336:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 774: rc = 0 00100000:10000000:1.0:1789117545.016465:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 774: rc = 0 00100000:10000000:1.0:1789117545.016777:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 774: rc = 0 00100000:10000000:1.0:1789117545.017040:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 774: rc = 0 00100000:10000000:1.0:1789117545.017658:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 774: rc = 0 00100000:10000000:1.0:1789117545.017920:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 774: rc = 0 00100000:10000000:1.0:1789117545.018347:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 774: rc = 0 00100000:10000000:1.0:1789117545.018652:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 774: rc = 0 00100000:10000000:1.0:1789117545.018895:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 774: rc = 0 00100000:10000000:1.0:1789117545.019288:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 774: rc = 0 00100000:10000000:1.0:1789117545.019577:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 774: rc = 0 00100000:10000000:1.0:1789117545.020046:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 774: rc = 0 00100000:10000000:0.0:1789117545.020548:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 774: rc = 0 00100000:10000000:0.0:1789117545.021036:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 774: rc = 0 00100000:10000000:0.0:1789117545.021287:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 774: rc = 0 00100000:10000000:0.0:1789117545.021543:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 774: rc = 0 00100000:10000000:0.0:1789117545.021824:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 774: rc = 0 00100000:10000000:0.0:1789117545.022996:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 774: rc = 0 00100000:10000000:0.0:1789117545.023801:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 367: rc = 0 00100000:10000000:0.0:1789117545.024668:0:14799:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1789117545.025211:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 514: rc = 0 00100000:10000000:0.0:1789117545.025591:0:14799:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1789117545.025679:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 514: rc = 0 00100000:10000000:0.0:1789117545.026010:0:14799:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1789117545.026074:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 514: rc = 0 00100000:10000000:0.0:1789117545.026671:0:14799:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1789117545.027138:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 507: rc = 0 00100000:10000000:0.0:1789117545.027348:0:14799:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1789117545.027457:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 507: rc = 0 00100000:10000000:0.0:1789117545.027736:0:14799:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1789117545.027804:0:14799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 507: rc = 0 00000020:00000080:0.0:1789117545.028048:0:14799:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789117545.028056:0:14799:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789117545.028065:0:14799:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7565228e460ec5c 00000020:01000004:0.0:1789117545.028073:0:14799:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1789117545.028077:0:14799:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789117545.028082:0:14799:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c1683d8b800 from MGS 00000020:01000004:0.0:1789117545.028086:0:14799:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789117545.028095:0:14799:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c178829b490) 00000020:00000080:0.0:1789117545.028104:0:14799:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789117545.028151:0:14799:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c1683d8b800 from MGS, refs=2 00080000:01000000:0.0:1789117545.028156:0:14799:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789117545.028162:0:14799:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7565228e460ec6a 00000100:00100000:0.0:1789117545.029283:0:14799:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789117545.029871:0:14799:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789117545.029877:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789117545.043732:0:14799:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789117545.043753:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789117545.045300:0:14799:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789117545.045718:0:14799:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789117545.045724:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789117545.048036:0:14799:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789117545.048047:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789117545.059109:0:14799:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789117545.059128:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789117545.066755:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117545.066760:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117545.066763:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117545.067133:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117545.067135:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117545.067137:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117545.067634:0:14799:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789117545.074924:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789117545.076907:0:14799:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789117545.076922:0:14799:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789117545.076925:0:14799:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789117545.078359:0:14808:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789117545.078543:0:14799:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789117545.078659:0:14799:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789117545.079111:0:14799:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789117545.079393:0:14799:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789117545.079579:0:14799:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789117545.079585:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789117545.084069:0:14799:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789117545.084083:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789117545.090790:0:14799:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789117545.090801:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789117545.094489:0:14799:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789117545.094511:0:14799:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.137@tcp' 00000020:01000004:1.0:1789117545.094513:0:14799:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789117545.094540:0:14799:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.137@tcp (typ=mgc) 00000020:00000080:1.0:1789117545.094551:0:14799:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.137@tcp (ffff9c17882db490) 00000020:00000080:1.0:1789117545.094566:0:14799:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789117545.094655:0:14799:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c17b866f000@MGC192.168.206.137@tcp: add connection 192.168.206.137@tcp at head 00010000:00010000:1.0:1789117545.094811:0:14799:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.137@tcp-0 is initialized 00000040:01000000:1.0:1789117545.094824:0:14799:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.137@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789117545.097184:0:14813:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789117545.101614:0:14815:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789117545.106171:0:14799:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.137@tcp (uuid 33b28d55-0a9c-4af4-874e-7f0dcd5828d4) 00000020:00000080:2.0:1789117545.106200:0:14799:0:(genops.c:1385:class_connect()) connect: client 33b28d55-0a9c-4af4-874e-7f0dcd5828d4, cookie 0xf7565228e460ec78 00000100:00080000:2.0:1789117545.106211:0:14799:0:(import.c:510:import_select_connection()) MGC192.168.206.137@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789117545.106226:0:14799:0:(import.c:624:import_select_connection()) MGC192.168.206.137@tcp: import ffff9c17b866f000 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:2.0:1789117545.106257:0:14799:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c17b87ea940 x1876025385506176/t0(0) o250->MGC192.168.206.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789117545.106616:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3297:1876025385506176:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789117545.106682:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117545.106825:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385506176 00000100:00100000:2.0:1789117545.106832:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385506176 00000100:00100000:2.0:1789117545.106870:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789117545.106877:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3297:x1876025385506176:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789117545.106907:0:14809:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 33b28d55-0a9c-4af4-874e-7f0dcd5828d4@0@lo t0 exp 0000000000000000 cur 392 last 0 00000020:00000080:2.0:1789117545.106935:0:14809:0:(genops.c:1385:class_connect()) connect: client 33b28d55-0a9c-4af4-874e-7f0dcd5828d4, cookie 0xf7565228e460ec7f 00000100:00080000:2.0:1789117545.107064:0:14809:0:(import.c:65:import_set_state_nolock()) ffff9c17b8647800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789117545.107148:0:14799:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 33b28d55-0a9c-4af4-874e-7f0dcd5828d4->MGS 00000020:01000004:3.0:1789117545.107165:0:14799:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789117545.107170:0:14799:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789117545.107181:0:14799:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9c17c1c61a48) 00000020:00000080:3.0:1789117545.107192:0:14799:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789117545.111853:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+5:3297:x1876025385506176:12345-0@lo:250:mount.lustre.0 Request processed in 4965us (5161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117545.111880:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789117545.114834:0:3297:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.137@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789117545.114848:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.137@tcp: connect to target with instance 0 00000100:00080000:1.0:1789117545.114856:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.137@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789117545.115959:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789117545.115968:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c17b866f000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789117545.115972:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789117545.115982:0:3297:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789117545.115990:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3297:1876025385506176:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789117545.122331:0:14799:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789117545.122727:0:14799:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789117545.122733:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789117545.126081:0:14799:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789117545.126093:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789117545.126798:0:14799:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789117545.126806:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789117545.127762:0:14799:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789117545.127939:0:14799:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789117545.127945:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789117545.129208:0:14799:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789117545.129219:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789117545.183142:0:14799:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789117545.183329:0:14799:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789117545.183335:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789117545.184673:0:14799:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789117545.184684:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789117545.199307:0:14799:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789117545.199535:0:14799:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789117545.199540:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789117545.205738:0:14799:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789117545.205754:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789117545.207659:0:14799:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789117545.207840:0:14799:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789117545.207846:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789117545.211663:0:14799:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789117545.211675:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789117545.212330:0:14799:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789117545.212520:0:14799:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789117545.212525:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789117545.213310:0:14799:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789117545.213317:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789117545.243636:0:14799:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789117545.245371:0:14799:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789117545.245381:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789117545.251059:0:14799:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789117545.251075:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789117545.254506:0:14799:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789117545.254664:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789117545.262767:0:14799:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789117545.262797:0:14799:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789117545.262803:0:14799:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.137@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789117545.263193:0:14799:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.137@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789117545.263227:0:14799:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.137@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789117545.263232:0:14799:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789117545.263234:0:14799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789117545.263235:0:14799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117545.263236:0:14799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789117545.263237:0:14799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117545.263239:0:14799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117545.263240:0:14799:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789117545.263241:0:14799:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789117545.263243:0:14799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117545.263244:0:14799:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789117545.263247:0:14799:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789117545.263249:0:14799:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789117545.263255:0:14799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789117545.263256:0:14799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117545.263257:0:14799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789117545.263258:0:14799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117545.263259:0:14799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117545.263260:0:14799:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789117545.263261:0:14799:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789117545.263262:0:14799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117545.263262:0:14799:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789117545.263287:0:14799:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789117545.263307:0:14799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385506304:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789117545.263393:0:14799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117545.263724:0:14799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17872d7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789117545.264324:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385506304 00000100:00100000:0.0:1789117545.264332:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385506304 00000100:00100000:2.0:1789117545.265096:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117545.265109:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+5:14799:x1876025385506304:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789117545.265150:0:14812:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789117545.265152:0:14812:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789117545.265155:0:14812:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789117545.265488:0:14833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789117545.265873:0:14812:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1789117545.270311:0:14834:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789117545.270319:0:14834:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789117545.270335:0:14834:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789117545.270508:0:14834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1789117545.272099:0:14812:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789117545.272110:0:14812:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789117545.280910:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+5:14799:x1876025385506304:12345-0@lo:253:mount.lustre.0 Request processed in 15797us (17508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117545.280948:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117545.281106:0:14799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385506304:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789117545.281121:0:14799:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789117545.281124:0:14799:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789117545.281126:0:14799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789117545.281127:0:14799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117545.281128:0:14799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789117545.281130:0:14799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117545.281131:0:14799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117545.281133:0:14799:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789117545.281134:0:14799:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789117545.281136:0:14799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117545.281138:0:14799:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789117545.281159:0:14799:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c1683d8b800 from lustre-MDT0000 10000000:01000000:2.0:1789117545.281182:0:14799:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789117545.281190:0:14799:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789117545.281194:0:14799:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c17882db490 10000000:01000000:2.0:1789117545.281198:0:14799:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789117545.281205:0:14799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c17882db490 from 1 10000000:01000000:2.0:1789117545.281208:0:14799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789117545.281245:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e600/0xf7565228e460ec8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117545.281255:0:14799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178457e600/0xf7565228e460ec8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117545.281265:0:14799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178457e600/0xf7565228e460ec8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117545.281284:0:14799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385506432:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789117545.281319:0:14799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117545.281356:0:14799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17872d7780 going to sleep for 11 seconds 00000100:00100000:1.0:1789117545.281492:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385506432 00000100:00100000:1.0:1789117545.281498:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385506432 00000100:00100000:1.0:1789117545.281532:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789117545.281541:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+5:14799:x1876025385506432:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789117545.281553:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117545.281567:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178442fc00/0xf7565228e460ec94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460ec8d expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117545.281589:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178442fc00/0xf7565228e460ec94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460ec8d expref: 6 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117545.281600:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178442fc00/0xf7565228e460ec94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460ec8d expref: 6 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117545.281621:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442fc00, rc 0) 00000100:00100000:1.0:1789117545.281661:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+6:14799:x1876025385506432:12345-0@lo:101:mount.lustre.0 Request processed in 121us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117545.281667:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117545.281791:0:14799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385506432:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789117545.281805:0:14799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178457e600/0xf7565228e460ec8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ec94 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117545.281813:0:14799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178457e600/0xf7565228e460ec8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460ec94 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117545.281872:0:14799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385506560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789117545.281898:0:14799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117545.281934:0:14799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17872d7780 going to sleep for 11 seconds 00000100:00100000:1.0:1789117545.282087:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385506560 00000100:00100000:1.0:1789117545.282092:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385506560 00000100:00100000:1.0:1789117545.282121:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789117545.282128:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+6:14799:x1876025385506560:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117545.282334:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+6:14799:x1876025385506560:12345-0@lo:501:mount.lustre.0 Request processed in 205us (433us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789117545.282341:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789117545.282439:0:14799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385506560:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789117545.282466:0:14799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789117545.282479:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e600/0xf7565228e460ec8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ec94 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117545.282487:0:14799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178457e600/0xf7565228e460ec8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ec94 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117545.282495:0:14799:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c1683d8b800 10000000:01000000:3.0:1789117545.282499:0:14799:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789117545.282503:0:14799:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c1683d8b800 10000000:01000000:3.0:1789117545.282505:0:14799:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789117545.282507:0:14799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c1683d8b800 from 1 10000000:01000000:3.0:1789117545.282510:0:14799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789117545.282531:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c16829c6200/0xf7565228e460ec9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117545.282538:0:14799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c16829c6200/0xf7565228e460ec9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117545.282545:0:14799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c16829c6200/0xf7565228e460ec9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117545.282558:0:14799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385506688:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789117545.282586:0:14799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117545.282622:0:14799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788377480 going to sleep for 11 seconds 00000100:00100000:0.0:1789117545.282692:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385506688 00000100:00100000:0.0:1789117545.282697:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385506688 00000100:00100000:0.0:1789117545.282715:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789117545.282722:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+6:14799:x1876025385506688:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789117545.282729:0:14810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117545.282741:0:14810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1787cbce00/0xf7565228e460eca2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460ec9b expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117545.282755:0:14810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1787cbce00/0xf7565228e460eca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460ec9b expref: 7 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117545.282764:0:14810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1787cbce00/0xf7565228e460eca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460ec9b expref: 7 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117545.282771:0:14810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbce00, rc 0) 00000100:00100000:0.0:1789117545.282811:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+7:14799:x1876025385506688:12345-0@lo:101:mount.lustre.0 Request processed in 89us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117545.282816:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789117545.284134:0:14799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385506688:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789117545.284153:0:14799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c16829c6200/0xf7565228e460ec9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460eca2 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117545.284164:0:14799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c16829c6200/0xf7565228e460ec9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460eca2 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117545.284181:0:14799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789117545.284197:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c16829c6200/0xf7565228e460ec9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460eca2 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117545.284205:0:14799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c16829c6200/0xf7565228e460ec9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460eca2 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117545.284212:0:14799:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789117545.284219:0:14799:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789117545.284224:0:14799:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c1683d8b800 10000000:01000000:3.0:1789117545.284226:0:14799:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789117545.284230:0:14799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789117545.284232:0:14799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789117545.284257:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c16829c7200/0xf7565228e460eca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117545.284264:0:14799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c16829c7200/0xf7565228e460eca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117545.284272:0:14799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c16829c7200/0xf7565228e460eca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117545.284301:0:14799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385506816:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789117545.284348:0:14799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117545.284390:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385506816 00000100:00100000:3.0:1789117545.284396:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385506816 00000100:00100000:3.0:1789117545.284461:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789117545.284469:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b9311450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+7:14799:x1876025385506816:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789117545.284479:0:14810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117545.284493:0:14810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c16829c7400/0xf7565228e460ecb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460eca9 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117545.284511:0:14810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c16829c7400/0xf7565228e460ecb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460eca9 expref: 8 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117545.284519:0:14810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c16829c7400/0xf7565228e460ecb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460eca9 expref: 8 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117545.284526:0:14810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c16829c7400, rc 0) 00000100:00100000:3.0:1789117545.284553:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b9311450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+8:14799:x1876025385506816:12345-0@lo:101:mount.lustre.0 Request processed in 85us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117545.284560:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789117545.284612:0:14799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788377480 going to sleep for 11 seconds 00000100:00100000:3.0:1789117545.284624:0:14799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385506816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789117545.284635:0:14799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c16829c7200/0xf7565228e460eca9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ecb0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117545.284642:0:14799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c16829c7200/0xf7565228e460eca9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460ecb0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117545.284696:0:14799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385506944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789117545.284720:0:14799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117545.284739:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385506944 00000100:00100000:3.0:1789117545.284743:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385506944 00000100:00100000:3.0:1789117545.284763:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789117545.284768:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b9312050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+8:14799:x1876025385506944:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789117545.286389:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b9312050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+9:14799:x1876025385506944:12345-0@lo:501:mount.lustre.0 Request processed in 1615us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117545.286428:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789117545.286480:0:14799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788377480 going to sleep for 11 seconds 00000100:00100000:3.0:1789117545.286501:0:14799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385506944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789117545.286544:0:14799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385507072:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789117545.286591:0:14799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117545.286627:0:14799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788377480 going to sleep for 11 seconds 00000100:00100000:2.0:1789117545.286714:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385507072 00000100:00100000:2.0:1789117545.286721:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385507072 00000100:00100000:2.0:1789117545.286775:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789117545.286785:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b9313050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+9:14799:x1876025385507072:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789117545.287104:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b9313050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+9:14799:x1876025385507072:12345-0@lo:503:mount.lustre.0 Request processed in 319us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117545.287111:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789117545.287360:0:14799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385507072:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789117545.288177:0:14835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0254f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14835:1876025385507200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117545.288231:0:14835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117545.288271:0:14835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c1d96b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789117545.290220:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385507200 00000100:00100000:3.0:1789117545.290233:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385507200 00000100:00100000:3.0:1789117545.290295:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789117545.290305:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b9313850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+9:14835:x1876025385507200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117545.290726:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b9313850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+9:14835:x1876025385507200:12345-0@lo:502:llog_process_th.0 Request processed in 420us (2491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117545.290735:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789117545.290904:0:14835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0254f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14835:1876025385507200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789117545.290948:0:14835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117545.290958:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117545.290961:0:14835:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789117545.290967:0:14835:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789117545.290977:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789117545.290991:0:14835:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c1788298000) 00000020:00000080:0.0:1789117545.291011:0:14835:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789117545.291017:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789117545.291103:0:14835:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789117545.291110:0:14835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7565228e460ecbe 00000020:00000080:0.0:1789117545.291325:0:14835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789117545.291330:0:14835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117545.291333:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117545.291335:0:14835:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789117545.291338:0:14835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117545.291341:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117545.291342:0:14835:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789117545.291346:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789117545.291352:0:14835:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c178829ced8) 00000020:00000080:0.0:1789117545.291361:0:14835:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789117545.291365:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789117545.291367:0:14835:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789117545.291370:0:14835:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789117545.291389:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789117545.291481:0:14835:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c1683d8b800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789117545.291502:0:14835:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c17bfa40000) 00000020:00000080:0.0:1789117545.291511:0:14835:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789117545.291558:0:14835:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789117545.291564:0:14835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7565228e460ecd3 00000020:00000080:0.0:1789117545.291664:0:14835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789117545.291670:0:14835:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789117545.291676:0:14835:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf7565228e460ecda 00080000:01000000:0.0:1789117545.291680:0:14835:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789117545.291683:0:14835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7565228e460ece1 00010000:00010000:2.0:1789117545.410334:0:14835:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789117545.410786:0:14835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1789117545.410969:0:14835:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789117545.411487:0:14835:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c16816e9a48) 00000020:00000080:2.0:1789117545.411506:0:14835:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789117545.411564:0:14835:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789117545.411570:0:14835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7565228e460ecef 00000020:00000080:0.0:1789117545.433661:0:14835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789117545.456187:0:14835:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf7565228e460ecf6 00000020:00000080:3.0:1789117545.460431:0:14835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789117545.460445:0:14835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117545.460452:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117545.460467:0:14835:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789117545.460471:0:14835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117545.460477:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117545.460478:0:14835:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789117545.460482:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789117545.460530:0:14835:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789117545.460547:0:14835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117545.460551:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117545.460552:0:14835:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789117545.460555:0:14835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789117545.460556:0:14835:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:3.0:1789117545.460558:0:14835:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789117545.460560:0:14835:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789117545.460562:0:14835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789117545.460564:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117545.460565:0:14835:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789117545.460567:0:14835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789117545.460570:0:14835:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789117545.460573:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117545.460574:0:14835:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789117545.460577:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789117545.460583:0:14835:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.137@tcp to nid 0x20000c0a8ce89 (192.168.206.137@tcp) 00000020:01000000:3.0:1789117545.460621:0:14835:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789117545.460625:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789117545.460641:0:14835:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c17c1c60000) 00000020:00000080:3.0:1789117545.460656:0:14835:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789117545.460663:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789117545.460715:0:14835:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789117545.460721:0:14835:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789117545.460727:0:14835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7565228e460ed04 00010000:00080000:3.0:1789117545.460770:0:14835:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1787216000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.137@tcp at head 00010000:00010000:3.0:1789117545.460983:0:14835:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1789117545.461337:0:14835:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789117545.461387:0:14835:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789117545.462298:0:14835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789117545.462361:0:14835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789117545.463017:0:14835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789117545.463853:0:14839:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789117545.463859:0:14839:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789117545.464963:0:14835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789117545.464975:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789117545.466721:0:14835:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789117545.466805:0:14835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7565228e460ed0b 00000100:00080000:3.0:1789117545.466816:0:14835:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789117545.466823:0:14835:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c1787216000 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:3.0:1789117545.466858:0:14835:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c17c01cc3c0 x1876025385507328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789117545.466926:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385507328:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789117545.466980:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025385507328 offset 0 length 520: 4 00000100:00080000:3.0:1789117545.467772:0:14835:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789117545.467874:0:14835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117545.467882:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117545.467883:0:14835:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789117545.467887:0:14835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789117545.467889:0:14835:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1789117545.467891:0:14835:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789117545.467893:0:14835:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789117545.467894:0:14835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789117545.467896:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117545.467898:0:14835:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789117545.467900:0:14835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789117545.467904:0:14835:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789117545.467907:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117545.467909:0:14835:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789117545.467913:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789117545.467917:0:14835:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.137@tcp to nid 0x20000c0a8ce89 (192.168.206.137@tcp) 00000020:01000000:3.0:1789117545.467938:0:14835:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789117545.467941:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789117545.467970:0:14835:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c17c1c63490) 00000020:00000080:3.0:1789117545.467988:0:14835:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789117545.468194:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789117545.468256:0:14835:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789117545.468262:0:14835:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789117545.468269:0:14835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7565228e460ed19 00010000:00080000:3.0:1789117545.468300:0:14835:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c17a7c11800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.137@tcp at head 00010000:00010000:3.0:1789117545.469377:0:14835:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789117545.469805:0:14835:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789117545.469827:0:14835:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789117545.473817:0:14835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789117545.473911:0:14835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789117545.473993:0:14835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1789117545.480756:0:14841:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789117545.480765:0:14841:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789117545.481625:0:14835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789117545.481637:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789117545.481667:0:14835:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789117545.481686:0:14835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7565228e460ed20 00000100:00080000:1.0:1789117545.481697:0:14835:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789117545.481703:0:14835:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c17a7c11800 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:1.0:1789117545.481735:0:14835:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c17b85c3480 x1876025385507456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789117545.481762:0:14835:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789117545.481810:0:14835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117545.481814:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117545.481815:0:14835:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789117545.481818:0:14835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117545.481822:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117545.481823:0:14835:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789117545.481826:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789117545.481828:0:14835:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789117545.481830:0:14835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117545.481832:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117545.481833:0:14835:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789117545.481836:0:14835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789117545.481837:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117545.481839:0:14835:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789117545.481841:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789117545.481876:0:14835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14835:1876025385507584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789117545.481947:0:14835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117545.481983:0:14835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17981800c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117545.482214:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385507584 00000100:00100000:3.0:1789117545.482220:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385507584 00000100:00100000:3.0:1789117545.482258:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789117545.482266:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b9312c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+9:14835:x1876025385507584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117545.482507:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b9312c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+9:14835:x1876025385507584:12345-0@lo:502:llog_process_th.0 Request processed in 240us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117545.482514:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789117545.482559:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385507456:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789117545.482582:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025385507456 offset 0 length 520: 4 00000100:00100000:1.0:1789117545.482727:0:14835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14835:1876025385507584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789117545.482753:0:14835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789117545.482758:0:14835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789117545.482760:0:14835:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789117545.482765:0:14835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789117545.483956:0:14799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1789117545.483987:0:14799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789117545.484010:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c16829c7200/0xf7565228e460eca9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ecb0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117545.484021:0:14799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c16829c7200/0xf7565228e460eca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ecb0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117545.484044:0:14799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1683d8b800 from 1 10000000:01000000:3.0:1789117545.484046:0:14799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789117545.484078:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c16829c6c00/0xf7565228e460ed27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117545.484101:0:14799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c16829c6c00/0xf7565228e460ed27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117545.484111:0:14799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c16829c6c00/0xf7565228e460ed27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117545.484130:0:14799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ced00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385507712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789117545.484178:0:14799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117545.484214:0:14799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b22b86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117545.484279:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385507712 00000100:00100000:2.0:1789117545.484285:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385507712 00000100:00100000:2.0:1789117545.484324:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789117545.484333:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b9310850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+9:14799:x1876025385507712:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789117545.484355:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117545.484372:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178457e800/0xf7565228e460ed2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460ed27 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117545.484393:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178457e800/0xf7565228e460ed2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460ed27 expref: 10 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117545.484428:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178457e800/0xf7565228e460ed2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460ed27 expref: 10 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117545.484438:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457e800, rc 0) 00000100:00100000:2.0:1789117545.484480:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b9310850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+10:14799:x1876025385507712:12345-0@lo:101:mount.lustre.0 Request processed in 148us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117545.484487:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789117545.484734:0:14799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ced00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385507712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789117545.484747:0:14799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c16829c6c00/0xf7565228e460ed27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ed2e expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117545.484756:0:14799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c16829c6c00/0xf7565228e460ed27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460ed2e expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117545.485289:0:14799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ced00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385507840:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789117545.485332:0:14799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117545.485366:0:14799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17b22b86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117545.485484:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385507840 00000100:00100000:2.0:1789117545.485489:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385507840 00000100:00100000:2.0:1789117545.485524:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789117545.485532:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b9312850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+10:14799:x1876025385507840:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789117545.485546:0:14812:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789117545.485552:0:14812:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789117545.485650:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b9312850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+10:14799:x1876025385507840:12345-0@lo:256:mount.lustre.0 Request processed in 118us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117545.485657:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789117545.486078:0:14799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ced00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385507840:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789117545.486703:0:14799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789117545.486728:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c16829c6c00/0xf7565228e460ed27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ed2e expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117545.486739:0:14799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c16829c6c00/0xf7565228e460ed27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ed2e expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117545.486747:0:14799:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1683d8b800 from 1 10000000:01000000:0.0:1789117545.486749:0:14799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789117545.486783:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1787cbca00/0xf7565228e460ed35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117545.486790:0:14799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c1787cbca00/0xf7565228e460ed35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117545.486798:0:14799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c1787cbca00/0xf7565228e460ed35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117545.486816:0:14799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0254f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385507968:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789117545.486863:0:14799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117545.486902:0:14799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c1d966c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117545.487295:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385507968 00000100:00100000:3.0:1789117545.487302:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385507968 00000100:00100000:3.0:1789117545.487348:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789117545.487365:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c2068850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+10:14799:x1876025385507968:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789117545.487377:0:14810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117545.487390:0:14810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c16829c7000/0xf7565228e460ed3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460ed35 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117545.487439:0:14810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c16829c7000/0xf7565228e460ed3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460ed35 expref: 11 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117545.487449:0:14810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c16829c7000/0xf7565228e460ed3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460ed35 expref: 11 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117545.487457:0:14810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c16829c7000, rc 0) 00000100:00100000:3.0:1789117545.487506:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c2068850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+11:14799:x1876025385507968:12345-0@lo:101:mount.lustre.0 Request processed in 143us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117545.487513:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789117545.487685:0:14799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0254f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385507968:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789117545.487700:0:14799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c1787cbca00/0xf7565228e460ed35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ed3c expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117545.487708:0:14799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c1787cbca00/0xf7565228e460ed35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460ed3c expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117545.487766:0:14799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0254f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385508096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789117545.487794:0:14799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117545.487832:0:14799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c1d966c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117545.487885:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385508096 00000100:00100000:3.0:1789117545.487890:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385508096 00000100:00100000:3.0:1789117545.487962:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789117545.487971:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c206a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+11:14799:x1876025385508096:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789117545.488345:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c206a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+11:14799:x1876025385508096:12345-0@lo:501:mount.lustre.0 Request processed in 375us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117545.488353:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789117545.488437:0:14799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0254f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385508096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117545.488471:0:14799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385508224:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789117545.488512:0:14799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117545.489388:0:14799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17981800c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117545.489525:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385508224 00000100:00100000:0.0:1789117545.489532:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385508224 00000100:00100000:0.0:1789117545.489569:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789117545.489576:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c206b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+11:14799:x1876025385508224:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789117545.489808:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c206b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+11:14799:x1876025385508224:12345-0@lo:503:mount.lustre.0 Request processed in 232us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117545.489817:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789117545.490041:0:14799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385508224:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789117545.490969:0:14843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14843:1876025385508352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117545.491028:0:14843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117545.491103:0:14843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c179054fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789117545.491144:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385508352 00000100:00100000:0.0:1789117545.491149:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385508352 00000100:00100000:0.0:1789117545.491218:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789117545.491226:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c206b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+11:14843:x1876025385508352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117545.495036:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c206b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+11:14843:x1876025385508352:12345-0@lo:502:llog_process_th.0 Request processed in 3802us (3999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117545.495049:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789117545.495179:0:14843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14843:1876025385508352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789117545.495211:0:14843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117545.495220:0:14843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117545.495223:0:14843:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789117545.495229:0:14843:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c1683d8b800 00000020:00000080:2.0:1789117545.495232:0:14843:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789117545.495240:0:14843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117545.495242:0:14843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117545.495243:0:14843:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789117545.495246:0:14843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117545.495248:0:14843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117545.495249:0:14843:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789117545.495252:0:14843:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c1683d8b800 00000020:00000080:2.0:1789117545.495254:0:14843:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789117545.495310:0:14843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117545.495313:0:14843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117545.495315:0:14843:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789117545.495317:0:14843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117545.495329:0:14843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117545.495330:0:14843:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789117545.495335:0:14843:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c1683d8b800 00000020:00000080:2.0:1789117545.495337:0:14843:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789117545.495357:0:14843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789117545.495359:0:14843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117545.495361:0:14843:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789117545.495364:0:14843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789117545.495366:0:14843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789117545.495367:0:14843:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789117545.495371:0:14843:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c1683d8b800 00000020:00000080:2.0:1789117545.495373:0:14843:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789117545.495442:0:14843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14843:1876025385508480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789117545.495488:0:14843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117545.500328:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385508480 00000100:00100000:3.0:1789117545.500342:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385508480 00000100:00100000:3.0:1789117545.500542:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789117545.500559:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c206b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+11:14843:x1876025385508480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789117545.500802:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c206b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+11:14843:x1876025385508480:12345-0@lo:502:llog_process_th.0 Request processed in 243us (5312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117545.500810:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789117545.501523:0:14843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17985ea9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117545.501552:0:14843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14843:1876025385508480:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789117545.501590:0:14843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117545.501597:0:14843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117545.501600:0:14843:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789117545.501615:0:14843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789117545.502479:0:14799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789117545.502510:0:14799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789117545.502528:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1787cbca00/0xf7565228e460ed35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ed3c expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117545.502538:0:14799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c1787cbca00/0xf7565228e460ed35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ed3c expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117545.502586:0:14799:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789117545.502589:0:14799:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c1683d8b800 10000000:01000000:0.0:1789117545.502592:0:14799:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c1683d8b800 10000000:01000000:0.0:1789117545.502597:0:14799:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789117545.502612:0:14799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c1683d8b800 from 1 10000000:01000000:0.0:1789117545.502615:0:14799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789117545.502652:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc600/0xf7565228e460ed43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117545.502660:0:14799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc600/0xf7565228e460ed43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117545.502669:0:14799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc600/0xf7565228e460ed43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117545.502688:0:14799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0256d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385508608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789117545.502745:0:14799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117545.502783:0:14799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c1d96b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789117545.502856:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385508608 00000100:00100000:2.0:1789117545.502862:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385508608 00000100:00100000:2.0:1789117545.502904:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789117545.502914:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+11:14799:x1876025385508608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789117545.502928:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117545.502941:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178457e000/0xf7565228e460ed4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460ed43 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117545.502964:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178457e000/0xf7565228e460ed4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460ed43 expref: 12 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117545.502975:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178457e000/0xf7565228e460ed4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460ed43 expref: 12 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117545.502983:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457e000, rc 0) 00000100:00100000:2.0:1789117545.503024:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:14799:x1876025385508608:12345-0@lo:101:mount.lustre.0 Request processed in 110us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117545.503039:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789117545.503196:0:14799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0256d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385508608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789117545.503352:0:14799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc600/0xf7565228e460ed43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ed4a expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117545.503363:0:14799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc600/0xf7565228e460ed43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460ed4a expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117545.503506:0:14799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0256d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385508736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789117545.503538:0:14799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117545.503561:0:14799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c1d96b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789117545.503576:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385508736 00000100:00100000:0.0:1789117545.503580:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385508736 00000100:00100000:0.0:1789117545.503615:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789117545.503622:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0249c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:14799:x1876025385508736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789117545.503856:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0249c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:14799:x1876025385508736:12345-0@lo:501:mount.lustre.0 Request processed in 233us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117545.503873:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789117545.503909:0:14799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0256d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385508736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789117545.503938:0:14799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0256d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385508864:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789117545.503979:0:14799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117545.503994:0:14799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c1d96b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789117545.504008:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385508864 00000100:00100000:0.0:1789117545.504011:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385508864 00000100:00100000:0.0:1789117545.504032:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789117545.504037:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0248050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:14799:x1876025385508864:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789117545.504209:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0248050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:14799:x1876025385508864:12345-0@lo:503:mount.lustre.0 Request processed in 171us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117545.504216:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789117545.504253:0:14799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0256d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385508864:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789117545.510336:0:14847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0256d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14847:1876025385508992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117545.510435:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117545.510472:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385508992 00000100:00100000:0.0:1789117545.510479:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385508992 00000100:00100000:0.0:1789117545.510511:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789117545.510519:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0248450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:14847:x1876025385508992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117545.510754:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0248450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:14847:x1876025385508992:12345-0@lo:502:llog_process_th.0 Request processed in 235us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117545.510762:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789117545.510810:0:14847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17c1d96b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789117545.510834:0:14847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0256d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14847:1876025385508992:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789117545.510900:0:14847:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789117545.510914:0:14847:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c17bfa43490) 00000020:00000080:0.0:1789117545.510933:0:14847:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1789117545.511014:0:14847:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c1683d8b800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789117545.511018:0:14847:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c1683d8b800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789117545.511021:0:14847:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c1683d8b800 4 00010000:00080000:0.0:1789117545.511057:0:14847:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1787d4b800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.137@tcp at head 00010000:00010000:0.0:1789117545.512816:0:14847:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1789117545.518799:0:14847:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789117545.518847:0:14847:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789117545.518859:0:14847:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf7565228e460ed58 00000100:00080000:0.0:1789117545.518870:0:14847:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789117545.518875:0:14847:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c1787d4b800 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:0.0:1789117545.518908:0:14847:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c17c0256d00 x1876025385509120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789117545.518936:0:14847:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789117545.519986:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0256d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876025385509120:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789117545.520073:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117545.520209:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385509120 00000100:00100000:0.0:1789117545.520216:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385509120 00000100:00100000:0.0:1789117545.520252:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117545.520259:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876025385509120:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789117545.520319:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876025385509120:12345-0@lo:38:llog_process_th.0 Request processed in 58us (245us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789117545.520326:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789117545.520491:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789117545.520500:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c1787d4b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789117545.520504:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789117545.520508:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0256d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876025385509120:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789117545.529096:0:14847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0257480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14847:1876025385509248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117545.529171:0:14847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117545.529210:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385509248 00000100:00100000:0.0:1789117545.529216:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385509248 00000100:00100000:0.0:1789117545.529267:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789117545.529276:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c024bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:14847:x1876025385509248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789117545.529527:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c024bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:14847:x1876025385509248:12345-0@lo:502:llog_process_th.0 Request processed in 251us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117545.529536:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789117545.529581:0:14847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1782dfde40 going to sleep for 11 seconds 00000100:00100000:0.0:1789117545.529612:0:14847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0257480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14847:1876025385509248:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789117545.529637:0:14847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789117545.529691:0:14799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789117545.529710:0:14799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789117545.529724:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc600/0xf7565228e460ed43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ed4a expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117545.529734:0:14799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c1787cbc600/0xf7565228e460ed43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ed4a expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789117545.529776:0:14799:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789117545.529778:0:14799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789117545.529779:0:14799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117545.529781:0:14799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117545.529782:0:14799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117545.529784:0:14799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117545.529785:0:14799:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789117545.529786:0:14799:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789117545.529788:0:14799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117545.529790:0:14799:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789117545.529793:0:14799:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789117545.529796:0:14799:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789117545.529797:0:14799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789117545.529799:0:14799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117545.529800:0:14799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117545.529801:0:14799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117545.529806:0:14799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117545.529808:0:14799:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789117545.529809:0:14799:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789117545.529810:0:14799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117545.529811:0:14799:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789117545.529825:0:14799:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789117545.529848:0:14799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385509376:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789117545.529881:0:14799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117545.529903:0:14799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1782dfde40 going to sleep for 11 seconds 00000100:00100000:2.0:1789117545.529907:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385509376 00000100:00100000:2.0:1789117545.529914:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385509376 00000100:00100000:2.0:1789117545.529947:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789117545.529960:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:14799:x1876025385509376:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789117545.529982:0:14809:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789117545.529995:0:14809:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789117545.604506:0:14809:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789117545.604529:0:14809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789117545.604660:0:14833:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789117545.604665:0:14833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789117545.604690:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c1787cbd200/0xf7565228e460ed5f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117545.604708:0:14833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178457e800/0xf7565228e460ed2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460ed27 expref: 12 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117545.604721:0:14833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c1787cbd200/0xf7565228e460ed5f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117545.604761:0:14833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178457e800/0xf7565228e460ed2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460ed27 expref: 12 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117545.604776:0:14833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c178457e800/0xf7565228e460ed2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460ed27 expref: 12 pid: 14809 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117545.604791:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0254780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14833:1876025385509504:0@lo:104: 00000100:00100000:0.0:1789117545.604871:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117545.605141:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385509504 00000100:00100000:1.0:1789117545.605148:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385509504 00000100:00100000:1.0:1789117545.605191:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789117545.605200:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+3:14833:x1876025385509504:12345-0@lo:104: 00010000:00010000:1.0:1789117545.605213:0:14800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c16829c6c00/0xf7565228e460ed27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460ed2e expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117545.605281:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789117545.605288:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+3:14833:x1876025385509504:12345-0@lo:104: Request processed in 90us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117545.605296:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789117545.605318:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117545.605323:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c16829c6c00/0xf7565228e460ed27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460ed2e expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117545.605330:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c6c00 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:1.0:1789117545.605334:0:14806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c16829c6c00/0xf7565228e460ed27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460ed2e expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117545.605343:0:14806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c16829c6c00/0xf7565228e460ed27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460ed2e expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117545.605350:0:14806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c16829c6c00/0xf7565228e460ed27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460ed2e expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117545.605355:0:14806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789117545.605383:0:14806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c16829c6c00/0xf7565228e460ed27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460ed2e expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117545.605390:0:14806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117545.605429:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c16829c6c00/0xf7565228e460ed27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460ed2e expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117545.605436:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c16829c6c00/0xf7565228e460ed27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460ed2e expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117545.605462:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117545.605464:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117545.605465:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117545.605492:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3301:1876025385509632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117545.605522:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117545.605596:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385509632 00000100:00100000:1.0:1789117545.605600:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385509632 00010000:00010000:1.0:1789117545.605627:0:14802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178457e800/0xf7565228e460ed2e lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460ed27 expref: 13 pid: 14809 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117545.605652:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789117545.605660:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+13:3301:x1876025385509632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117545.605670:0:14802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117545.605675:0:14802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178457e800/0xf7565228e460ed2e lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460ed27 expref: 13 pid: 14809 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117545.605685:0:14802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178457e800/0xf7565228e460ed2e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460ed27 expref: 13 pid: 14809 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117545.605701:0:14802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c1787cbd200/0xf7565228e460ed5f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117545.605708:0:14802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1787cbd200/0xf7565228e460ed5f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789117545.605888:0:14802:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001223590s 00010000:00010000:1.0:1789117545.605894:0:14802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1787cbd200/0xf7565228e460ed5f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117545.605911:0:14802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1787cbd200/0xf7565228e460ed5f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117545.605918:0:14802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c1787cbd200/0xf7565228e460ed5f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117545.605926:0:14802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c1787cbd200/0xf7565228e460ed5f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117545.605932:0:14802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd200 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:1.0:1789117545.605938:0:14802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c1787cbd200/0xf7565228e460ed5f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117545.605946:0:14802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c1787cbd200/0xf7565228e460ed5f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117545.605956:0:14802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c1787cbd200/0xf7565228e460ed5f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117545.605966:0:14802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117545.606013:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+13:3301:x1876025385509632:12345-0@lo:103:ldlm_bl.0 Request processed in 355us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117545.606020:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789117545.606808:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1782dfd600 going to sleep for 11 seconds 00010000:00010000:2.0:1789117545.606837:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178457e800/0xf7565228e460ed2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460ed27 expref: 12 pid: 14809 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117545.606851:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0254780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14833:1876025385509504:0@lo:104: 00010000:00010000:2.0:1789117545.606872:0:14833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c1787cbd200/0xf7565228e460ed5f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117545.606881:0:14833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c1787cbd200/0xf7565228e460ed5f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117545.606887:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c1787cbd200/0xf7565228e460ed5f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117545.606894:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1787cbd200/0xf7565228e460ed5f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117545.606957:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3301:1876025385509632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117545.620782:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+11:14799:x1876025385509376:12345-0@lo:253:mount.lustre.0 Request processed in 90819us (90892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117545.620797:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789117545.620896:0:14799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14799:1876025385509376:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789117545.620912:0:14799:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789117545.620915:0:14799:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789117545.620917:0:14799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789117545.620927:0:14799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117545.620928:0:14799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117545.620929:0:14799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117545.620931:0:14799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117545.620932:0:14799:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789117545.620934:0:14799:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789117545.620935:0:14799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117545.620937:0:14799:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789117545.620951:0:14799:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789117545.628214:0:14799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789117545.628351:0:14799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789117545.628625:0:14799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789117545.628761:0:14799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789117545.628994:0:14799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789117545.629131:0:14799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789117545.631325:0:14799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789117545.635101:0:14799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789117545.635443:0:14799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789117545.635733:0:14799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789117545.636015:0:14799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789117545.636174:0:14799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1789117545.721020:0:14799:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1789117545.722663:0:14799:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789117545.723499:0:14858:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789117545.723596:0:14858:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1789117545.727484:0:14857:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1789117545.727491:0:14857:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1789117545.729817:0:14858:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789117545.729900:0:14858:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789117545.729904:0:14858:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1789117545.732195:0:14799:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789117545.732323:0:14799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789117545.733545:0:14799:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789117545.733561:0:14799:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789117545.733775:0:14799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789117545.736818:0:14799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789117545.737572:0:14799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789117545.737624:0:14799:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789117545.738171:0:14799:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1789117545.739157:0:14799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1789117545.745175:0:14799:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1789117545.825960:0:14799:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789117545.825998:0:14799:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc6b01863988 00100000:10000000:0.0:1789117545.826007:0:14799:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789117545.827941:0:14799:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789117545.827957:0:14799:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.137@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789117545.827968:0:14799:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789117545.827993:0:14799:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789117546.118592:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789117546.375464:0:14815:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789117546.375471:0:14815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1683d8b800 from 6 10000000:01000000:0.0:1789117546.375477:0:14815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789117546.375520:0:14815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1787cbde00/0xf7565228e460ed66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117546.375532:0:14815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c1787cbde00/0xf7565228e460ed66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117546.375541:0:14815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c1787cbde00/0xf7565228e460ed66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117546.375564:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0257480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385509760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789117546.375638:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117546.375709:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1782dfd600 going to sleep for 11 seconds 00000100:00100000:1.0:1789117546.375831:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385509760 00000100:00100000:1.0:1789117546.375849:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385509760 00000100:00100000:1.0:1789117546.375899:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789117546.375908:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c024ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+11:14815:x1876025385509760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117546.375920:0:14810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117546.375932:0:14810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178442e200/0xf7565228e460ed6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460ed66 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117546.375951:0:14810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178442e200/0xf7565228e460ed6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460ed66 expref: 12 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117546.375962:0:14810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178442e200/0xf7565228e460ed6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460ed66 expref: 12 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117546.375971:0:14810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e200, rc 0) 00000100:00100000:1.0:1789117546.376803:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c024ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:14815:x1876025385509760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 893us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117546.376812:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789117546.381194:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0257480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385509760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117546.381224:0:14815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c1787cbde00/0xf7565228e460ed66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ed6d expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117546.381236:0:14815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c1787cbde00/0xf7565228e460ed66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460ed6d expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117546.381310:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0257480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385509888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789117546.381376:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117546.381443:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1782dfd600 going to sleep for 11 seconds 00000100:00100000:2.0:1789117546.381538:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385509888 00000100:00100000:2.0:1789117546.381545:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385509888 00000100:00100000:2.0:1789117546.381594:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789117546.381613:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0248c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:14815:x1876025385509888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789117546.381633:0:14809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789117546.381649:0:14809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789117546.381653:0:14809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789117546.381750:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0248c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:14815:x1876025385509888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117546.381758:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789117546.381910:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0257480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385509888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789117546.381951:0:14815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789117546.381958:0:14815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1787cbde00/0xf7565228e460ed66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ed6d expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117546.381967:0:14815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c1787cbde00/0xf7565228e460ed66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ed6d expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789117546.565701:0:14852:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789117546.565709:0:14852:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789117546.566057:0:14852:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1789117546.566064:0:14852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789117547.141809:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789117547.590916:0:14852:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789117547.590928:0:14852:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789117547.590961:0:14852:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1789117547.590966:0:14852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789117548.166235:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117549.189571:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117550.219030:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789117550.616616:0:15101:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg637-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1789117550.665823:0:480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789117550.665830:0:480:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789117550.665834:0:480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789117550.665837:0:480:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789117550.665839:0:480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789117550.665843:0:480:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789117550.665847:0:480:0:(import.c:65:import_set_state_nolock()) ffff9c1787d4b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789117550.665859:0:480:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c1787d4b800 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:2.0:1789117550.665880:0:480:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c17b87e9680 x1876025385510144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789117550.665942:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789117550.665955:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3299:1876025385510016:0@lo:400:kworker.0 00000100:00100000:2.0:1789117550.666041:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117550.666146:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876025385510144:0@lo:38:kworker.0 00000100:00100000:2.0:1789117550.666178:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117550.666207:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385510016 00000100:00100000:2.0:1789117550.666214:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385510016 00000100:00100000:2.0:1789117550.666251:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789117550.666260:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0249050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:3299:x1876025385510016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117550.666303:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0249050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:3299:x1876025385510016:12345-0@lo:400:kworker.0 Request processed in 44us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117550.666311:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789117550.666353:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3299:1876025385510016:0@lo:400:kworker.0 00000100:00100000:3.0:1789117550.669019:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385510144 00000100:00100000:3.0:1789117550.669040:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385510144 00000100:00100000:3.0:1789117550.669135:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789117550.669144:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1876025385510144:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789117550.669194:0:14819:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 397 last 0 00000020:00000080:3.0:1789117550.669241:0:14819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf7565228e460ed74 00000004:00100000:3.0:1789117550.669264:0:14819:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789117550.669472:0:14819:0:(import.c:65:import_set_state_nolock()) ffff9c17a976d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789117550.669602:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1876025385510144:12345-0@lo:38:kworker.0 Request processed in 457us (3421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117550.669610:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789117550.669695:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c17b87e9680 x1876025385510144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789117560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789117550.669717:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789117550.669725:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789117550.669731:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789117550.669734:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c1787d4b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789117550.669741:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876025385510144:0@lo:38:kworker.0 00010000:00010000:0.0:1789117551.242020:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117552.261632:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117553.286524:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789117553.491615:0:15252:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6d899300 20000000:00000080:1.0:1789117553.491631:0:15252:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c17bb8fbc00 uarg=0000000000000000 20000000:01000000:1.0:1789117553.491663:0:15252:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789117553.491671:0:15252:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789117553.491676:0:15252:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789117553.492841:0:15253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1789117553.493178:0:15252:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789117553.499505:0:15252:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789117553.499534:0:15252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c178442f800/0xf7565228e460ed7b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117553.499552:0:15252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c16829c7000/0xf7565228e460ed3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460ed35 expref: 11 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117553.499570:0:15252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c178442f800/0xf7565228e460ed7b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117553.499609:0:15252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c16829c7000/0xf7565228e460ed3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460ed35 expref: 11 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117553.499623:0:15252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c16829c7000/0xf7565228e460ed3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460ed35 expref: 11 pid: 14810 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117553.499650:0:15252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c1e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15252:1876025385510272:0@lo:104: 00000100:00100000:1.0:1789117553.499711:0:15252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117553.499763:0:15252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17ad1bb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117553.500001:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385510272 00000100:00100000:2.0:1789117553.500009:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385510272 00000100:00100000:2.0:1789117553.500630:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117553.500642:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+3:15252:x1876025385510272:12345-0@lo:104: 00010000:00010000:2.0:1789117553.500658:0:14801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c1787cbca00/0xf7565228e460ed35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460ed3c expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117553.500746:0:14801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789117553.500752:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+3:15252:x1876025385510272:12345-0@lo:104: Request processed in 115us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117553.500759:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789117553.500903:0:15252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c1e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15252:1876025385510272:0@lo:104: 00010000:00010000:3.0:1789117553.500924:0:15252:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c178442f800/0xf7565228e460ed7b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117553.501146:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117553.501154:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c1787cbca00/0xf7565228e460ed35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460ed3c expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117553.501161:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbca00 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:0.0:1789117553.501165:0:14805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c1787cbca00/0xf7565228e460ed35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460ed3c expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117553.501172:0:14805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c1787cbca00/0xf7565228e460ed35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460ed3c expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117553.501189:0:14805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c1787cbca00/0xf7565228e460ed35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460ed3c expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117553.501195:0:14805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789117553.501273:0:14805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c1787cbca00/0xf7565228e460ed35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460ed3c expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117553.501279:0:14805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117553.501298:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c1787cbca00/0xf7565228e460ed35 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460ed3c expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117553.501304:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c1787cbca00/0xf7565228e460ed35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460ed3c expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117553.501318:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117553.501319:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117553.501321:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117553.501330:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3299:1876025385510400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789117553.501364:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117553.501432:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385510400 00000100:00100000:0.0:1789117553.501437:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385510400 00010000:00010000:0.0:1789117553.501455:0:14803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c16829c7000/0xf7565228e460ed3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460ed35 expref: 12 pid: 14810 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117553.501478:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789117553.501485:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0254b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:3299:x1876025385510400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789117553.501496:0:14803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117553.501501:0:14803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c16829c7000/0xf7565228e460ed3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460ed35 expref: 12 pid: 14810 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117553.501517:0:14803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c16829c7000/0xf7565228e460ed3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460ed35 expref: 12 pid: 14810 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117553.501529:0:14803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c16829c7000/0xf7565228e460ed3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460ed35 expref: 12 pid: 14810 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117553.501540:0:14803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c178442f800/0xf7565228e460ed7b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117553.501547:0:14803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178442f800/0xf7565228e460ed7b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117553.501571:0:14803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178442f800/0xf7565228e460ed7b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117553.501580:0:14803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178442f800/0xf7565228e460ed7b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117553.501586:0:14803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c178442f800/0xf7565228e460ed7b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117553.501593:0:14803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c178442f800/0xf7565228e460ed7b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117553.501599:0:14803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442f800 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:0.0:1789117553.501602:0:14803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c178442f800/0xf7565228e460ed7b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117553.501609:0:14803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c178442f800/0xf7565228e460ed7b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117553.501632:0:14803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c178442f800/0xf7565228e460ed7b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117553.501641:0:14803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117553.501671:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0254b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+11:3299:x1876025385510400:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117553.501678:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789117553.501702:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3299:1876025385510400:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789117553.502855:0:15252:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c178442f800/0xf7565228e460ed7b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117553.502868:0:15252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c178442f800/0xf7565228e460ed7b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117553.502874:0:15252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178442f800/0xf7565228e460ed7b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117554.309604:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789117554.565490:0:14815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789117554.565498:0:14815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1683d8b800 from 13 10000000:01000000:3.0:1789117554.565503:0:14815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789117554.565550:0:14815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c16829c6600/0xf7565228e460ed82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117554.565573:0:14815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c16829c6600/0xf7565228e460ed82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117554.565601:0:14815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c16829c6600/0xf7565228e460ed82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117554.565624:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385510528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789117554.565697:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117554.565746:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1798180a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789117554.566131:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385510528 00000100:00100000:0.0:1789117554.566138:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385510528 00000100:00100000:0.0:1789117554.566191:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789117554.566200:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c024b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+11:14815:x1876025385510528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117554.566216:0:14812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117554.566229:0:14812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1787cbcc00/0xf7565228e460ed89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460ed82 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117554.566251:0:14812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1787cbcc00/0xf7565228e460ed89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460ed82 expref: 12 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117554.566262:0:14812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1787cbcc00/0xf7565228e460ed89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460ed82 expref: 12 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117554.566271:0:14812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbcc00, rc 0) 00000100:00100000:0.0:1789117554.566323:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c024b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:14815:x1876025385510528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117554.566330:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789117554.566418:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385510528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117554.566434:0:14815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c16829c6600/0xf7565228e460ed82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ed89 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117554.566444:0:14815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c16829c6600/0xf7565228e460ed82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460ed89 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117554.566508:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385510656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117554.566540:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117554.566586:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1798180a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789117554.566690:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385510656 00000100:00100000:1.0:1789117554.566694:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385510656 00000100:00100000:1.0:1789117554.566724:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789117554.566731:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c024b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:14815:x1876025385510656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117554.566975:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c024b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:14815:x1876025385510656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117554.566982:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789117554.567060:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385510656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117554.567089:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385510784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117554.567126:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117554.567151:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1798180a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789117554.567825:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385510784 00000100:00100000:0.0:1789117554.567832:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385510784 00000100:00100000:0.0:1789117554.567863:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789117554.567870:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c024a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:14815:x1876025385510784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117554.568019:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c024a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:14815:x1876025385510784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117554.568026:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789117554.570428:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385510784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789117554.573078:0:15310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789117554.573486:0:14815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789117554.573506:0:14815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117554.573517:0:14815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c16829c6600/0xf7565228e460ed82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ed89 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117554.573540:0:14815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c16829c6600/0xf7565228e460ed82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ed89 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117555.334639:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789117555.781536:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789117555.781542:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789117555.781545:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789117555.781556:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789117555.781616:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3300:1876025385510912:0@lo:400:kworker.0 00000100:00100000:3.0:1789117555.781684:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117555.781740:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117555.781746:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385511040:0@lo:400:kworker.0 00000100:00100000:3.0:1789117555.781779:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117555.781843:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385510912 00000100:00100000:2.0:1789117555.781849:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385510912 00000100:00100000:2.0:1789117555.781894:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789117555.781904:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c024a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:3300:x1876025385510912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117555.781952:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c024a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:3300:x1876025385510912:12345-0@lo:400:kworker.0 Request processed in 49us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117555.781959:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789117555.782035:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3300:1876025385510912:0@lo:400:kworker.0 00000100:00100000:0.0:1789117555.782142:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385511040 00000100:00100000:0.0:1789117555.782147:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385511040 00000100:00100000:0.0:1789117555.782219:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117555.782227:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385511040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117555.782278:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385511040:12345-0@lo:400:kworker.0 Request processed in 52us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117555.782285:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789117555.782334:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c17b87ea580 x1876025385511040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117555.782346:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385511040:0@lo:400:kworker.0 00000100:00100000:2.0:1789117555.783878:0:3297:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789117545/real 1789117545] req@ffff9c17b85c3480 x1876025385507456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117555 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117555.783900:0:3297:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c17b85c3480 x1876025385507456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117555 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117555.783910:0:3297:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789117545/real 1789117545] req@ffff9c17c01cc3c0 x1876025385507328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117555 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117555.783933:0:3297:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c17c01cc3c0 x1876025385507328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117555 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789117555.783949:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c17a7c11800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789117555.783965:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789117555.783969:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385507456:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789117555.783974:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c1787216000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789117555.783979:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789117555.783982:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385507328:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789117555.784011:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789117555.784015:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789117555.784017:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c1787216000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789117555.784021:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 392 00000100:00080000:2.0:1789117555.784025:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789117555.784030:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c1787216000 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:2.0:1789117555.784056:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c17b87ea580 x1876025385511168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789117555.784071:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789117555.784074:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789117555.784075:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c17a7c11800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789117555.784078:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 392 00000100:00080000:2.0:1789117555.784081:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789117555.784084:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c17a7c11800 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:2.0:1789117555.784095:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c17b87ea1c0 x1876025385511296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789117555.784124:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385511168:0@lo:8:kworker.0 00000400:00000100:2.0:1789117555.784164:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025385511168 offset 0 length 520: 4 00000100:00100000:2.0:1789117555.784194:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385511296:0@lo:8:kworker.0 00000400:00000100:2.0:1789117555.784214:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025385511296 offset 0 length 520: 4 00010000:00010000:1.0:1789117556.363564:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117557.392011:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789117557.835994:0:14852:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789117557.836003:0:14852:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789117557.836544:0:14852:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1789117557.836610:0:14852:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789117557.836634:0:14852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000020:01000004:0.0:1789117558.172795:0:15500:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789117558.172798:0:15500:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1789117558.173645:0:15500:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c17c03a5000 00000020:01000004:0.0:1789117558.173661:0:15500:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789117558.173673:0:15500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789117558.173686:0:15500:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c17bfa44ed8) 00000020:00000080:0.0:1789117558.173702:0:15500:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789117558.201468:0:15500:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789117558.201700:0:15500:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789117558.202983:0:15500:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789117558.203269:0:15500:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1789117558.203528:0:15500:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789117558.203894:0:15500:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:1.0:1789117558.204037:0:15500:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:1.0:1789117558.204136:0:15500:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:1.0:1789117558.204580:0:15500:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 701: rc = 0 00100000:10000000:1.0:1789117558.204956:0:15500:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 701: rc = 0 00100000:10000000:1.0:1789117558.205210:0:15500:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 701: rc = 0 00100000:10000000:1.0:1789117558.205496:0:15500:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 701: rc = 0 00100000:10000000:1.0:1789117558.205753:0:15500:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 701: rc = 0 00100000:10000000:1.0:1789117558.207520:0:15500:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 701: rc = 0 00000020:00000080:3.0:1789117558.220329:0:15500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789117558.220342:0:15500:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789117558.220353:0:15500:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf7565228e460ed97 00000020:01000004:3.0:1789117558.220361:0:15500:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789117558.220381:0:15500:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.137@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789117558.220384:0:15500:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789117558.220390:0:15500:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789117558.220394:0:15500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789117558.220430:0:15500:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c17c1c64ed8) 00000020:00000080:3.0:1789117558.220442:0:15500:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789117558.230639:0:15500:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789117558.231308:0:15500:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789117558.231314:0:15500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789117558.234316:0:15500:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789117558.234329:0:15500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789117558.236066:0:15500:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789117558.236078:0:15500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789117558.239254:0:15500:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789117558.239987:0:15500:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789117558.239995:0:15500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789117558.246260:0:15500:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789117558.246277:0:15500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789117558.271453:0:15500:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789117558.271727:0:15500:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789117558.271734:0:15500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789117558.275226:0:15500:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789117558.275240:0:15500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789117558.283741:0:15500:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789117558.283779:0:15500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789117558.295209:0:15500:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789117558.295426:0:15500:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789117558.295433:0:15500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789117558.301659:0:15500:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789117558.301679:0:15500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789117558.386292:0:15500:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789117558.386711:0:15500:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789117558.386718:0:15500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789117558.389283:0:15500:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789117558.389297:0:15500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789117558.397094:0:15500:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789117558.397119:0:15500:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789117558.397124:0:15500:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.137@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00010000:00010000:3.0:1789117558.405964:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789117558.417843:0:15500:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.137@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789117558.417878:0:15500:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.137@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789117558.417883:0:15500:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789117558.417885:0:15500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789117558.417886:0:15500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789117558.417888:0:15500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789117558.417889:0:15500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789117558.417890:0:15500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789117558.417892:0:15500:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789117558.417893:0:15500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789117558.417895:0:15500:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789117558.417898:0:15500:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789117558.417900:0:15500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789117558.417901:0:15500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789117558.417902:0:15500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789117558.417904:0:15500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789117558.417905:0:15500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789117558.417906:0:15500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789117558.417907:0:15500:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789117558.417908:0:15500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789117558.417909:0:15500:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789117558.417933:0:15500:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789117558.417951:0:15500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385511424:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789117558.418017:0:15500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117558.418225:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385511424 00000100:00100000:2.0:1789117558.418231:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385511424 00000100:00100000:2.0:1789117558.418288:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789117558.418297:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c024b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:15500:x1876025385511424:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789117558.418338:0:14810:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789117558.418341:0:14810:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789117558.418345:0:14810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789117558.419003:0:15500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17872d7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117558.453076:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c024b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:15500:x1876025385511424:12345-0@lo:253:mount.lustre.0 Request processed in 34771us (35049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117558.453091:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789117558.455462:0:15500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385511424:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789117558.455480:0:15500:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789117558.455484:0:15500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789117558.455576:0:15500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789117558.455579:0:15500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789117558.455581:0:15500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789117558.455582:0:15500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789117558.455584:0:15500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789117558.455585:0:15500:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789117558.455602:0:15500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789117558.455603:0:15500:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789117558.455622:0:15500:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c17c03a5000 from lustre-OST0000 10000000:01000000:3.0:1789117558.455651:0:15500:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789117558.455654:0:15500:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789117558.455661:0:15500:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c17882db490 local copy 00010000:00010000:3.0:1789117558.455670:0:15500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e600/0xf7565228e460ec8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ec94 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117558.456115:0:15500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385511552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789117558.456172:0:15500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117558.456273:0:15500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178c604c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117558.456334:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385511552 00000100:00100000:1.0:1789117558.456340:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385511552 00000100:00100000:1.0:1789117558.456511:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789117558.456520:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c024a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:15500:x1876025385511552:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117558.456713:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c024a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:15500:x1876025385511552:12345-0@lo:501:mount.lustre.0 Request processed in 194us (540us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789117558.456722:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789117558.456787:0:15500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385511552:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789117558.456800:0:15500:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789117558.456953:0:15500:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789117558.456971:0:15500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e600/0xf7565228e460ec8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ec94 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117558.456981:0:15500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178457e600/0xf7565228e460ec8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ec94 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117558.457009:0:15500:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c17c03a5000 10000000:01000000:3.0:1789117558.457013:0:15500:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789117558.457018:0:15500:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c17882db490 10000000:01000000:3.0:1789117558.457020:0:15500:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789117558.457024:0:15500:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c17882db490 from 1 10000000:01000000:3.0:1789117558.457026:0:15500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789117558.457049:0:15500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c16829c7600/0xf7565228e460eda5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117558.457069:0:15500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c16829c7600/0xf7565228e460eda5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117558.457077:0:15500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c16829c7600/0xf7565228e460eda5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117558.457090:0:15500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385511680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789117558.457118:0:15500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117558.457601:0:15500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178c604c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117558.459080:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385511680 00000100:00100000:0.0:1789117558.459090:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385511680 00000100:00100000:0.0:1789117558.459136:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789117558.459145:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0249450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+12:15500:x1876025385511680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789117558.459170:0:14812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117558.459187:0:14812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1787cbc800/0xf7565228e460edac lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460eda5 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117558.459210:0:14812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1787cbc800/0xf7565228e460edac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460eda5 expref: 13 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117558.459220:0:14812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1787cbc800/0xf7565228e460edac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460eda5 expref: 13 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117558.459230:0:14812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbc800, rc 0) 00000100:00100000:0.0:1789117558.459298:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0249450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+13:15500:x1876025385511680:12345-0@lo:101:mount.lustre.0 Request processed in 155us (2180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117558.459306:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789117558.459633:0:15500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385511680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789117558.459650:0:15500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c16829c7600/0xf7565228e460eda5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460edac expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117558.459660:0:15500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c16829c7600/0xf7565228e460eda5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460edac expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117558.459679:0:15500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789117558.459698:0:15500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c16829c7600/0xf7565228e460eda5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460edac expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117558.459714:0:15500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c16829c7600/0xf7565228e460eda5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460edac expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117558.459723:0:15500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789117558.459728:0:15500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789117558.459734:0:15500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789117558.459737:0:15500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789117558.459766:0:15500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c16829c6a00/0xf7565228e460edb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117558.459775:0:15500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c16829c6a00/0xf7565228e460edb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117558.459783:0:15500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c16829c6a00/0xf7565228e460edb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117558.459801:0:15500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385511808:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789117558.459835:0:15500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117558.459872:0:15500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178c604c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117558.460155:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385511808 00000100:00100000:0.0:1789117558.460160:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385511808 00000100:00100000:0.0:1789117558.460184:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789117558.460191:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+13:15500:x1876025385511808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789117558.460199:0:14812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117558.460208:0:14812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1787cbc200/0xf7565228e460edba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460edb3 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117558.460223:0:14812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1787cbc200/0xf7565228e460edba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460edb3 expref: 14 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117558.460231:0:14812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1787cbc200/0xf7565228e460edba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460edb3 expref: 14 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117558.460238:0:14812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbc200, rc 0) 00000100:00100000:0.0:1789117558.460294:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+14:15500:x1876025385511808:12345-0@lo:101:mount.lustre.0 Request processed in 101us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117558.460303:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789117558.460592:0:15500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385511808:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789117558.460605:0:15500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c16829c6a00/0xf7565228e460edb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460edba expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117558.460613:0:15500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c16829c6a00/0xf7565228e460edb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460edba expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789117558.462246:0:15500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789117558.463812:0:15500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789117558.464271:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789117558.464316:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789117558.464349:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789117558.464392:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789117558.465150:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789117558.465198:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789117558.465279:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789117558.465287:0:15500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789117558.465372:0:15500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385511936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789117558.465467:0:15500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117558.465653:0:15500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178c604c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117558.465799:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385511936 00000100:00100000:0.0:1789117558.465805:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385511936 00000100:00100000:0.0:1789117558.465968:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789117558.465979:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+14:15500:x1876025385511936:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789117558.466316:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+14:15500:x1876025385511936:12345-0@lo:501:mount.lustre.0 Request processed in 338us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117558.466324:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789117558.466393:0:15500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385511936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789117558.466475:0:15500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385512064:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789117558.466529:0:15500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117558.467445:0:15500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178c604c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117558.467599:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385512064 00000100:00100000:1.0:1789117558.467606:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385512064 00000100:00100000:1.0:1789117558.467639:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789117558.467647:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+14:15500:x1876025385512064:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789117558.468311:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+14:15500:x1876025385512064:12345-0@lo:503:mount.lustre.0 Request processed in 661us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117558.468320:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789117558.468604:0:15500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385512064:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789117558.471323:0:15500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789117558.471429:0:15500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385512192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789117558.471591:0:15500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117558.471822:0:15500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178c604c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117558.471949:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385512192 00000100:00100000:1.0:1789117558.471956:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385512192 00000100:00100000:1.0:1789117558.472269:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789117558.472280:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+14:15500:x1876025385512192:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789117558.472596:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+14:15500:x1876025385512192:12345-0@lo:502:mount.lustre.0 Request processed in 317us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117558.472604:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789117558.472827:0:15500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385512192:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789117558.473121:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789117558.473172:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789117558.473205:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789117558.473253:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789117558.473290:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789117558.473324:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789117558.473369:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789117558.473429:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789117558.473464:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789117558.473818:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789117558.473873:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789117558.473934:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789117558.473972:0:15500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385512320:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789117558.474027:0:15500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117558.474634:0:15500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178c604c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117558.474709:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385512320 00000100:00100000:0.0:1789117558.474715:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385512320 00000100:00100000:2.0:1789117558.475049:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789117558.475060:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+14:15500:x1876025385512320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789117558.475266:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+14:15500:x1876025385512320:12345-0@lo:502:mount.lustre.0 Request processed in 208us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117558.475280:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789117558.475362:0:15500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385512320:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789117558.475480:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789117558.475504:0:15500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1789117558.476928:0:15517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789117558.476937:0:15517:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789117558.476942:0:15517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117558.476945:0:15517:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789117558.476949:0:15517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789117558.476986:0:15517:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c1683390000) 00000020:00000080:3.0:1789117558.477005:0:15517:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789117558.477012:0:15517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789117558.477268:0:15517:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c17c03a5000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789117558.477276:0:15517:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789117558.477282:0:15517:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf7565228e460edc8 00010000:00010000:3.0:1789117558.482369:0:15517:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1789117558.483239:0:15517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1789117558.486216:0:15517:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1789117558.490208:0:15517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789117558.490221:0:15517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117558.490227:0:15517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117558.490229:0:15517:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789117558.490232:0:15517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789117558.490235:0:15517:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789117558.490236:0:15517:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789117558.490238:0:15517:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789117558.490239:0:15517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789117558.490241:0:15517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117558.490243:0:15517:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789117558.490245:0:15517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117558.490247:0:15517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117558.490249:0:15517:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789117558.490260:0:15517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789117558.490262:0:15517:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789117558.490264:0:15517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117558.490267:0:15517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117558.490268:0:15517:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789117558.490271:0:15517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117558.490273:0:15517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117558.490275:0:15517:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789117558.490278:0:15517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789117558.490314:0:15517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117558.490318:0:15517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117558.490319:0:15517:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789117558.490322:0:15517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1789117558.491144:0:15500:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789117558.491179:0:15500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789117558.491201:0:15500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c16829c6a00/0xf7565228e460edb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460edba expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117558.491213:0:15500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c16829c6a00/0xf7565228e460edb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460edba expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117558.491222:0:15500:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c17c03a5000 from 1 10000000:01000000:1.0:1789117558.491224:0:15500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789117558.491256:0:15500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178442e400/0xf7565228e460edcf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117558.491265:0:15500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178442e400/0xf7565228e460edcf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117558.491274:0:15500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178442e400/0xf7565228e460edcf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117558.491296:0:15500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385512448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789117558.491357:0:15500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117558.491428:0:15500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c179054f480 going to sleep for 11 seconds 00000100:00100000:2.0:1789117558.492035:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385512448 00000100:00100000:2.0:1789117558.492108:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385512448 00000100:00100000:2.0:1789117558.492158:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789117558.492167:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+14:15500:x1876025385512448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789117558.492181:0:14810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117558.492195:0:14810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178457ea00/0xf7565228e460edd6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460edcf expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.492218:0:14810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178457ea00/0xf7565228e460edd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460edcf expref: 15 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.492227:0:14810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178457ea00/0xf7565228e460edd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460edcf expref: 15 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.492235:0:14810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457ea00, rc 0) 00000100:00100000:2.0:1789117558.492277:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+15:15500:x1876025385512448:12345-0@lo:101:mount.lustre.0 Request processed in 112us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117558.492284:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789117558.492635:0:15500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385512448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789117558.492651:0:15500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178442e400/0xf7565228e460edcf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460edd6 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117558.492660:0:15500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178442e400/0xf7565228e460edcf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460edd6 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789117558.494878:0:15500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789117558.495485:0:15500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789117558.495758:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789117558.495802:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789117558.495880:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789117558.495889:0:15500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789117558.495954:0:15500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385512576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117558.496012:0:15500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117558.496446:0:15500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c179054f480 going to sleep for 11 seconds 00000100:00100000:2.0:1789117558.496723:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385512576 00000100:00100000:2.0:1789117558.496731:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385512576 00000100:00100000:2.0:1789117558.496781:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789117558.496791:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+15:15500:x1876025385512576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789117558.497313:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+15:15500:x1876025385512576:12345-0@lo:501:mount.lustre.0 Request processed in 521us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117558.497321:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789117558.497442:0:15500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385512576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117558.497479:0:15500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385512704:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789117558.497643:0:15500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117558.497678:0:15500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c179054f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789117558.497737:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385512704 00000100:00100000:0.0:1789117558.497743:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385512704 00000100:00100000:0.0:1789117558.497773:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789117558.497780:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+15:15500:x1876025385512704:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789117558.497934:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+15:15500:x1876025385512704:12345-0@lo:503:mount.lustre.0 Request processed in 154us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117558.497941:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789117558.498276:0:15500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385512704:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789117558.499448:0:15500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789117558.499557:0:15500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385512832:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789117558.499617:0:15500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117558.499655:0:15500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788257b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789117558.500000:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385512832 00000100:00100000:0.0:1789117558.500007:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385512832 00000100:00100000:0.0:1789117558.500060:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789117558.500070:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+15:15500:x1876025385512832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789117558.500253:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+15:15500:x1876025385512832:12345-0@lo:502:mount.lustre.0 Request processed in 183us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117558.500260:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789117558.500506:0:15500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385512832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789117558.500990:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789117558.501107:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789117558.501161:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789117558.501197:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789117558.501228:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789117558.501270:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789117558.501304:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789117558.501336:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:2.0:1789117558.501379:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:2.0:1789117558.501986:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:2.0:1789117558.502118:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10256 00000100:00100000:2.0:1789117558.502159:0:15500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385512960:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789117558.502219:0:15500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117558.502253:0:15500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788257b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789117558.508807:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385512960 00000100:00100000:1.0:1789117558.508821:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385512960 00000100:00100000:1.0:1789117558.508880:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789117558.508889:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+15:15500:x1876025385512960:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789117558.509146:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+15:15500:x1876025385512960:12345-0@lo:502:mount.lustre.0 Request processed in 258us (6926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117558.509155:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789117558.509586:0:15500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385512960:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789117558.509704:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10480 00000040:00080000:3.0:1789117558.509720:0:15500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789117558.518284:0:15521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117558.518296:0:15521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117558.518299:0:15521:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789117558.518306:0:15521:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c17c03a5000 00000020:00000080:3.0:1789117558.518308:0:15521:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117558.518314:0:15521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117558.518316:0:15521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117558.518318:0:15521:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789117558.518320:0:15521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117558.518323:0:15521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117558.518324:0:15521:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789117558.518327:0:15521:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c17c03a5000 00000020:00000080:3.0:1789117558.518329:0:15521:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117558.518385:0:15521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117558.518388:0:15521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117558.518390:0:15521:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789117558.518392:0:15521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117558.518438:0:15521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117558.518439:0:15521:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789117558.518444:0:15521:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c17c03a5000 00000020:00000080:3.0:1789117558.518447:0:15521:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117558.518466:0:15521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117558.518469:0:15521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117558.518470:0:15521:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789117558.518473:0:15521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789117558.518475:0:15521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117558.518476:0:15521:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789117558.518479:0:15521:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c17c03a5000 00000020:00000080:3.0:1789117558.518481:0:15521:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789117558.518525:0:15521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789117558.518528:0:15521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789117558.518529:0:15521:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789117558.518542:0:15521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789117558.520656:0:15500:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789117558.520694:0:15500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789117558.520713:0:15500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178442e400/0xf7565228e460edcf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460edd6 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.520724:0:15500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178442e400/0xf7565228e460edcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460edd6 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117558.520771:0:15500:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789117558.520779:0:15500:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c17c03a5000 10000000:01000000:2.0:1789117558.520782:0:15500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c17c03a5000 10000000:01000000:2.0:1789117558.520786:0:15500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789117558.520791:0:15500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c17c03a5000 from 1 10000000:01000000:2.0:1789117558.520793:0:15500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789117558.520827:0:15500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460eddd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.520835:0:15500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460eddd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.520844:0:15500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460eddd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117558.520881:0:15500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385513088:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789117558.520946:0:15500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117558.520986:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385513088 00000100:00100000:2.0:1789117558.520992:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385513088 00000100:00100000:2.0:1789117558.521030:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789117558.521039:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+15:15500:x1876025385513088:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789117558.521052:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117558.521064:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178457e200/0xf7565228e460ede4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460eddd expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.521087:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178457e200/0xf7565228e460ede4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460eddd expref: 16 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.521097:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178457e200/0xf7565228e460ede4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460eddd expref: 16 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.521115:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457e200, rc 0) 00000100:00100000:2.0:1789117558.521146:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:15500:x1876025385513088:12345-0@lo:101:mount.lustre.0 Request processed in 108us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117558.521153:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789117558.521195:0:15500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788257000 going to sleep for 11 seconds 00000100:00100000:2.0:1789117558.521216:0:15500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385513088:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789117558.521229:0:15500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460eddd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ede4 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.521238:0:15500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460eddd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460ede4 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789117558.521786:0:15500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789117558.526702:0:15500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789117558.527006:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789117558.527054:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789117558.527082:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789117558.527117:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789117558.527146:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789117558.527182:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789117558.527210:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789117558.527235:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789117558.527271:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789117558.527297:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789117558.527323:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789117558.527358:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789117558.527386:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789117558.527442:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789117558.527503:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789117558.527553:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789117558.527586:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789117558.527653:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789117558.527689:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789117558.527722:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789117558.527772:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789117558.527807:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789117558.532224:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789117558.532320:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789117558.532359:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789117558.532394:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789117558.532476:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789117558.532526:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789117558.532624:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789117558.532632:0:15500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1789117558.532735:0:15500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385513216:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789117558.532800:0:15500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117558.532844:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385513216 00000100:00100000:2.0:1789117558.532863:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385513216 00000100:00100000:2.0:1789117558.532904:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789117558.532912:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:15500:x1876025385513216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789117558.533126:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:15500:x1876025385513216:12345-0@lo:501:mount.lustre.0 Request processed in 214us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117558.533134:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789117558.533177:0:15500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788257000 going to sleep for 11 seconds 00000100:00100000:2.0:1789117558.533198:0:15500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385513216:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789117558.533232:0:15500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385513344:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789117558.533271:0:15500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117558.533299:0:15500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788257000 going to sleep for 11 seconds 00000100:00100000:1.0:1789117558.534992:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385513344 00000100:00100000:1.0:1789117558.535002:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385513344 00000100:00100000:1.0:1789117558.535079:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789117558.535088:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:15500:x1876025385513344:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789117558.535291:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:15500:x1876025385513344:12345-0@lo:503:mount.lustre.0 Request processed in 203us (2019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117558.535298:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789117558.535467:0:15500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385513344:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789117558.536614:0:15500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789117558.536696:0:15500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385513472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789117558.536757:0:15500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117558.536793:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385513472 00000100:00100000:2.0:1789117558.536800:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385513472 00000100:00100000:2.0:1789117558.536831:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789117558.536838:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:15500:x1876025385513472:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789117558.537202:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:15500:x1876025385513472:12345-0@lo:502:mount.lustre.0 Request processed in 362us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117558.537210:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789117558.537259:0:15500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788257000 going to sleep for 11 seconds 00000100:00100000:2.0:1789117558.537277:0:15500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385513472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789117558.538749:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789117558.538836:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789117558.539646:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789117558.539726:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789117558.539769:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789117558.539818:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789117558.539936:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789117558.539974:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789117558.540032:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789117558.540070:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789117558.540104:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789117558.540152:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789117558.540190:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789117558.540226:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789117558.540287:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789117558.540321:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789117558.540357:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789117558.540451:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789117558.541090:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789117558.541137:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789117558.541193:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789117558.541230:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789117558.541264:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789117558.541310:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789117558.541346:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789117558.541380:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789117558.546517:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789117558.546596:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789117558.546632:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789117558.546679:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789117558.546716:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789117558.546751:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789117558.546785:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789117558.547020:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789117558.547062:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789117558.547109:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789117558.547146:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789117558.547180:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789117558.547229:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789117558.547265:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789117558.547315:0:15500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385513600:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789117558.547386:0:15500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117558.547450:0:15500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788257000 going to sleep for 11 seconds 00000100:00100000:3.0:1789117558.548904:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385513600 00000100:00100000:3.0:1789117558.548915:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385513600 00000100:00100000:3.0:1789117558.548977:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789117558.548986:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:15500:x1876025385513600:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789117558.549241:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:15500:x1876025385513600:12345-0@lo:502:mount.lustre.0 Request processed in 255us (1855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117558.549249:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789117558.549473:0:15500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385513600:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789117558.549655:0:15500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1789117558.549678:0:15500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789117558.562484:0:15527:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789117558.562517:0:15527:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c1683393490) 00000020:00000080:3.0:1789117558.562553:0:15527:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789117558.562641:0:15527:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c17c03a5000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789117558.562645:0:15527:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c17c03a5000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789117558.562648:0:15527:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c17c03a5000 3 00010000:00080000:3.0:1789117558.562676:0:15527:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c17b8be9800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.137@tcp at head 00010000:00010000:3.0:1789117558.569962:0:15527:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1789117558.570164:0:15527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789117558.570201:0:15527:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789117558.570213:0:15527:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf7565228e460edf2 00000100:00080000:3.0:1789117558.570221:0:15527:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789117558.570227:0:15527:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c17b8be9800 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:3.0:1789117558.570257:0:15527:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c17c01cc780 x1876025385513728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789117558.570277:0:15527:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789117558.570861:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876025385513728:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789117558.570932:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117558.572081:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385513728 00000100:00100000:3.0:1789117558.572091:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385513728 00000100:00100000:3.0:1789117558.572131:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789117558.572138:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1876025385513728:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789117558.572164:0:14819:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 405 last 0 00000020:00000080:3.0:1789117558.572213:0:14819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf7565228e460edf9 00000004:00100000:3.0:1789117558.572227:0:14819:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789117558.572258:0:14819:0:(import.c:65:import_set_state_nolock()) ffff9c1798b5c000 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1789117558.572997:0:15527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1789117558.573042:0:15500:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789117558.573065:0:15500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789117558.573079:0:15500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460eddd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ede4 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.573089:0:15500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178457f400/0xf7565228e460eddd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ede4 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789117558.573129:0:15500:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789117558.573132:0:15500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789117558.573133:0:15500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117558.573134:0:15500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789117558.573136:0:15500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117558.573137:0:15500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117558.573138:0:15500:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789117558.573140:0:15500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117558.573141:0:15500:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789117558.573144:0:15500:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789117558.573146:0:15500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789117558.573148:0:15500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789117558.573149:0:15500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117558.573150:0:15500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789117558.573151:0:15500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117558.573152:0:15500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117558.573153:0:15500:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789117558.573154:0:15500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117558.573155:0:15500:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789117558.573174:0:15500:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789117558.573190:0:15500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385513856:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789117558.573248:0:15500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117558.573288:0:15500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1788257540 going to sleep for 11 seconds 00000100:00080000:1.0:1789117558.573512:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117558.573517:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789117558.573520:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117558.573523:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789117558.573575:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385513856 00000100:00100000:1.0:1789117558.573579:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385513856 00000100:00100000:1.0:1789117558.573621:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789117558.573629:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:15500:x1876025385513856:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789117558.573650:0:14810:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789117558.573661:0:14810:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789117558.574175:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876025385513984:0@lo:400:kworker.0 00000100:00100000:1.0:1789117558.574218:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117558.574288:0:14817:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789117558.574296:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789117558.574842:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385513984 00000100:00100000:1.0:1789117558.574969:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385513984 00000100:00100000:3.0:1789117558.575129:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1876025385513728:12345-0@lo:38:llog_process_th.0 Request processed in 2989us (4195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117558.575139:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789117558.575160:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789117558.575168:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876025385513984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117558.575205:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876025385513984:12345-0@lo:400:kworker.0 Request processed in 38us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117558.575212:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789117558.580588:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c17c01cc780 x1876025385513728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789117568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117558.580603:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789117558.580614:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789117558.580622:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789117558.580628:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789117558.580631:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c17b8be9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789117558.580638:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876025385513728:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789117558.588508:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c17b85c0f00 x1876025385513984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117558.588543:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876025385513984:0@lo:400:kworker.0 20000000:01000000:1.0:1789117558.671229:0:14810:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789117558.671250:0:14810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789117558.671354:0:14833:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789117558.671359:0:14833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789117558.671378:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c16829c7a00/0xf7565228e460ee00 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117558.671438:0:14833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178442e200/0xf7565228e460ed6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460ed66 expref: 16 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117558.671446:0:14833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c16829c7a00/0xf7565228e460ee00 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117558.671482:0:14833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178442e200/0xf7565228e460ed6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460ed66 expref: 16 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117558.671606:0:14833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c178442e200/0xf7565228e460ed6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460ed66 expref: 16 pid: 14810 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117558.671621:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ccb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14833:1876025385514112:0@lo:104: 00000100:00100000:3.0:1789117558.671696:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117558.671758:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178c604300 going to sleep for 11 seconds 00000100:00100000:0.0:1789117558.671884:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385514112 00000100:00100000:0.0:1789117558.671891:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385514112 00000100:00100000:0.0:1789117558.671939:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789117558.671949:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+3:14833:x1876025385514112:12345-0@lo:104: 00010000:00010000:0.0:1789117558.671962:0:14801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c1787cbde00/0xf7565228e460ed66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460ed6d expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117558.672010:0:14801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789117558.672016:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+3:14833:x1876025385514112:12345-0@lo:104: Request processed in 70us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117558.672022:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789117558.672451:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ccb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14833:1876025385514112:0@lo:104: 00010000:00010000:3.0:1789117558.672470:0:14833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c16829c7a00/0xf7565228e460ee00 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.672645:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117558.672653:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c1787cbde00/0xf7565228e460ed66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460ed6d expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.672661:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbde00 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:2.0:1789117558.672676:0:14805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c1787cbde00/0xf7565228e460ed66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460ed6d expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.672685:0:14805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c1787cbde00/0xf7565228e460ed66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460ed6d expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789117558.672693:0:14805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c1787cbde00/0xf7565228e460ed66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460ed6d expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117558.672700:0:14805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789117558.672737:0:14805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c1787cbde00/0xf7565228e460ed66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460ed6d expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.672743:0:14805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789117558.672770:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c1787cbde00/0xf7565228e460ed66 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460ed6d expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.672789:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c1787cbde00/0xf7565228e460ed66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460ed6d expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.672806:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117558.672807:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117558.672809:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117558.672816:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117558.672827:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3298:1876025385514240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117558.672876:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117558.672982:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385514240 00000100:00100000:2.0:1789117558.672987:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385514240 00010000:00010000:2.0:1789117558.673010:0:14804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178442e200/0xf7565228e460ed6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460ed66 expref: 17 pid: 14810 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117558.673034:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117558.673041:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87eb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+17:3298:x1876025385514240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789117558.673052:0:14804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117558.673057:0:14804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178442e200/0xf7565228e460ed6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460ed66 expref: 17 pid: 14810 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.673067:0:14804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178442e200/0xf7565228e460ed6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460ed66 expref: 17 pid: 14810 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.673079:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178442e200/0xf7565228e460ed6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460ed66 expref: 17 pid: 14810 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.673092:0:14804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c16829c7a00/0xf7565228e460ee00 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.673109:0:14804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c16829c7a00/0xf7565228e460ee00 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789117558.673123:0:14804:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001764885s 00010000:00010000:2.0:1789117558.673128:0:14804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c16829c7a00/0xf7565228e460ee00 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.673136:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c16829c7a00/0xf7565228e460ee00 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.673143:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c16829c7a00/0xf7565228e460ee00 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.673149:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c16829c7a00/0xf7565228e460ee00 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.673155:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c7a00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117558.673158:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c16829c7a00/0xf7565228e460ee00 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.673166:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c16829c7a00/0xf7565228e460ee00 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.673180:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c16829c7a00/0xf7565228e460ee00 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.673189:0:14804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117558.673220:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87eb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:3298:x1876025385514240:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117558.673227:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117558.673263:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3298:1876025385514240:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789117558.673280:0:14833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c16829c7a00/0xf7565228e460ee00 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.673288:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c16829c7a00/0xf7565228e460ee00 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117558.673295:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c16829c7a00/0xf7565228e460ee00 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117558.683743:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+15:15500:x1876025385513856:12345-0@lo:253:mount.lustre.0 Request processed in 110106us (110486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117558.683773:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789117558.683890:0:15500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87eb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:15500:1876025385513856:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789117558.683905:0:15500:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789117558.683908:0:15500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789117558.683910:0:15500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789117558.683911:0:15500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789117558.683913:0:15500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789117558.683914:0:15500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789117558.683915:0:15500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789117558.683916:0:15500:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789117558.683918:0:15500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789117558.683919:0:15500:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789117558.683939:0:15500:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789117558.691074:0:15500:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789117558.691246:0:15500:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789117558.691446:0:15500:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789117558.693193:0:15500:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789117558.693658:0:15500:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1789117558.693818:0:15500:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789117558.695974:0:15500:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789117558.818177:0:15500:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789117558.818185:0:15500:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789117558.818232:0:15500:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789117558.818291:0:15500:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.137@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789117558.818306:0:15500:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789117558.818333:0:15500:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789117559.429587:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789117560.325605:0:14815:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789117560.325612:0:14815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1683d8b800 from 7 10000000:01000000:3.0:1789117560.325618:0:14815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789117560.325677:0:14815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c16829c6400/0xf7565228e460ee07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.325689:0:14815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c16829c6400/0xf7565228e460ee07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.325700:0:14815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c16829c6400/0xf7565228e460ee07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117560.325725:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385514368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789117560.325794:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117560.325880:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385514368 00000100:00100000:0.0:1789117560.325888:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385514368 00000100:00100000:0.0:1789117560.325950:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789117560.325960:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+15:14815:x1876025385514368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117560.325973:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117560.325987:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1787cbda00/0xf7565228e460ee0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460ee07 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.326010:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1787cbda00/0xf7565228e460ee0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460ee07 expref: 16 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.326022:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1787cbda00/0xf7565228e460ee0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460ee07 expref: 16 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.326045:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbda00, rc 0) 00000100:00100000:3.0:1789117560.326110:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681f1dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117560.334629:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:14815:x1876025385514368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 8661us (8826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117560.334642:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789117560.334766:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385514368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117560.334790:0:14815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c16829c6400/0xf7565228e460ee07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ee0e expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.334803:0:14815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c16829c6400/0xf7565228e460ee07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460ee0e expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117560.334874:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385514496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789117560.334913:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117560.334950:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681f1dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117560.334995:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385514496 00000100:00100000:1.0:1789117560.335002:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385514496 00000100:00100000:1.0:1789117560.335046:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789117560.335055:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:14815:x1876025385514496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789117560.335074:0:14810:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789117560.335090:0:14810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789117560.335093:0:14810:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789117560.335194:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:14815:x1876025385514496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117560.335201:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789117560.335554:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385514496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789117560.335607:0:14815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789117560.335615:0:14815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c16829c6400/0xf7565228e460ee07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ee0e expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117560.335628:0:14815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c16829c6400/0xf7565228e460ee07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ee0e expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117560.455268:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117561.477630:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117562.502014:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117563.526050:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789117563.974550:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117563.974556:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789117563.974560:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789117563.974563:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789117563.974672:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789117563.974692:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385514880:0@lo:400:kworker.0 00000100:00100000:1.0:1789117563.974770:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117563.974955:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3300:1876025385514624:0@lo:400:kworker.0 00000100:00100000:0.0:1789117563.974988:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117563.975019:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789117563.975025:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385514752:0@lo:400:kworker.0 00000100:00100000:0.0:1789117563.975045:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117563.975070:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385514880 00000100:00100000:0.0:1789117563.975077:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385514880 00000100:00100000:0.0:1789117563.975117:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385514752 00000100:00100000:0.0:1789117563.975119:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385514752 00000100:00100000:0.0:1789117563.975145:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789117563.975154:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385514880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117563.975202:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385514880:12345-0@lo:400:kworker.0 Request processed in 49us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117563.975209:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789117563.975223:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789117563.975228:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0256580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385514752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117563.975254:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0256580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385514752:12345-0@lo:400:kworker.0 Request processed in 25us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117563.975276:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789117563.975305:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789117563.975333:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c17b85c1680 x1876025385514752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117563.975347:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385514752:0@lo:400:kworker.0 00010000:00080000:0.0:1789117563.975375:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c17b85c0b40 x1876025385514880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117563.975384:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385514880:0@lo:400:kworker.0 00000100:00100000:1.0:1789117563.975516:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385514624 00000100:00100000:1.0:1789117563.975520:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385514624 00000100:00100000:1.0:1789117563.975552:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789117563.975560:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:3300:x1876025385514624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117563.975595:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:3300:x1876025385514624:12345-0@lo:400:kworker.0 Request processed in 36us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117563.975601:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789117563.976179:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3300:1876025385514624:0@lo:400:kworker.0 00000001:02000400:3.0:1789117564.347219:0:15873:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg637-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789117564.550329:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117565.576173:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117566.597906:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789117567.046071:0:14852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789117567.622929:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117568.645738:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789117569.093931:0:15683:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789117569.093939:0:15683:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789117569.093942:0:15683:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789117569.093945:0:15683:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789117569.093995:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385515136:0@lo:400:kworker.0 00000100:00100000:3.0:1789117569.094054:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117569.094107:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117569.094113:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385515264:0@lo:400:kworker.0 00000100:00100000:3.0:1789117569.094134:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117569.094165:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385515136 00000100:00100000:3.0:1789117569.094172:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385515136 00000100:00100000:3.0:1789117569.094205:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385515264 00000100:00100000:3.0:1789117569.094207:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385515264 00000100:00100000:3.0:1789117569.094230:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789117569.094237:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385515136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117569.094279:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385515136:12345-0@lo:400:kworker.0 Request processed in 42us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117569.094286:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789117569.094301:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789117569.094320:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385515264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117569.094348:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876025385515264:12345-0@lo:400:kworker.0 Request processed in 29us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117569.094355:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789117569.094375:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789117569.094395:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c17c01ce940 x1876025385515264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117569.094435:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876025385515264:0@lo:400:kworker.0 00010000:00080000:3.0:1789117569.094446:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c17c01cf840 x1876025385515136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117569.094454:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385515136:0@lo:400:kworker.0 00000100:00100000:0.0:1789117569.094573:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3299:1876025385515008:0@lo:400:kworker.0 00000100:00100000:0.0:1789117569.094607:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117569.094651:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385515008 00000100:00100000:3.0:1789117569.094658:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385515008 00000100:00100000:0.0:1789117569.094881:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789117569.094888:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:3299:x1876025385515008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117569.094934:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:3299:x1876025385515008:12345-0@lo:400:kworker.0 Request processed in 45us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117569.094940:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789117569.095262:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3299:1876025385515008:0@lo:400:kworker.0 00010000:00010000:3.0:1789117569.677806:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789117570.675838:0:16222:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789117570.675843:0:16222:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789117570.676013:0:16222:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c178548a000 00000020:01000004:3.0:1789117570.676029:0:16222:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789117570.676041:0:16222:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789117570.676054:0:16222:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c1683394ed8) 00000020:00000080:3.0:1789117570.676070:0:16222:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00010000:00010000:1.0:1789117570.696487:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789117570.710450:0:16222:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789117570.710723:0:16222:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789117570.712375:0:16222:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789117570.712780:0:16222:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789117570.713128:0:16222:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789117570.713576:0:16222:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 549: rc = 0 00100000:10000000:2.0:1789117570.713677:0:16222:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 549: rc = 0 00100000:10000000:2.0:1789117570.713773:0:16222:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 549: rc = 0 00100000:10000000:2.0:1789117570.715025:0:16222:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 689: rc = 0 00100000:10000000:2.0:1789117570.715266:0:16222:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 689: rc = 0 00100000:10000000:2.0:1789117570.716386:0:16222:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 689: rc = 0 00100000:10000000:2.0:1789117570.719291:0:16222:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 689: rc = 0 00100000:10000000:0.0:1789117570.720317:0:16222:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 689: rc = 0 00100000:10000000:0.0:1789117570.721335:0:16222:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 689: rc = 0 00000020:00000080:0.0:1789117570.722941:0:16222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789117570.727150:0:16222:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789117570.727172:0:16222:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf7565228e460ee1c 00000020:01000004:0.0:1789117570.727181:0:16222:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1789117570.727204:0:16222:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.137@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789117570.727219:0:16222:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789117570.727229:0:16222:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789117570.727259:0:16222:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1789117570.727263:0:16222:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.137@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789117570.758191:0:16222:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.137@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789117570.758233:0:16222:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.137@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789117570.758237:0:16222:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789117570.758239:0:16222:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789117570.758240:0:16222:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117570.758242:0:16222:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117570.758243:0:16222:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117570.758244:0:16222:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117570.758246:0:16222:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789117570.758248:0:16222:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117570.758249:0:16222:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789117570.758252:0:16222:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789117570.758254:0:16222:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789117570.758256:0:16222:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789117570.758257:0:16222:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117570.758258:0:16222:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117570.758259:0:16222:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117570.758259:0:16222:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117570.758260:0:16222:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789117570.758261:0:16222:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117570.758262:0:16222:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789117570.758287:0:16222:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789117570.758307:0:16222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385515392:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789117570.758377:0:16222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117570.758464:0:16222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17870ec840 going to sleep for 11 seconds 00000100:00100000:1.0:1789117570.759871:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385515392 00000100:00100000:1.0:1789117570.759884:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385515392 00000100:00100000:1.0:1789117570.759940:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789117570.759961:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:16222:x1876025385515392:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789117570.760007:0:14810:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789117570.760012:0:14810:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789117570.760015:0:14810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789117570.772859:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:16222:x1876025385515392:12345-0@lo:253:mount.lustre.0 Request processed in 12901us (14471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.772873:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789117570.773237:0:16222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385515392:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789117570.773252:0:16222:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789117570.773256:0:16222:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789117570.773258:0:16222:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789117570.773259:0:16222:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117570.773260:0:16222:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117570.773275:0:16222:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117570.773277:0:16222:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117570.773278:0:16222:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789117570.773280:0:16222:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117570.773282:0:16222:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789117570.773301:0:16222:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c178548a000 from lustre-OST0001 10000000:01000000:0.0:1789117570.773327:0:16222:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789117570.773330:0:16222:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789117570.773337:0:16222:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c17882db490 local copy 00010000:00010000:0.0:1789117570.773347:0:16222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e600/0xf7565228e460ec8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ec94 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117570.773797:0:16222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385515520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789117570.773843:0:16222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117570.773881:0:16222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17870ec0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117570.774169:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385515520 00000100:00100000:1.0:1789117570.774176:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385515520 00000100:00100000:1.0:1789117570.774229:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789117570.774240:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:16222:x1876025385515520:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117570.774431:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:16222:x1876025385515520:12345-0@lo:501:mount.lustre.0 Request processed in 193us (586us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789117570.774441:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789117570.775605:0:16222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385515520:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789117570.775627:0:16222:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789117570.776687:0:16222:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789117570.776698:0:16222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e600/0xf7565228e460ec8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ec94 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.776709:0:16222:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178457e600/0xf7565228e460ec8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ec94 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117570.776736:0:16222:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c178548a000 10000000:01000000:2.0:1789117570.776741:0:16222:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789117570.776746:0:16222:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789117570.776748:0:16222:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789117570.776753:0:16222:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789117570.776755:0:16222:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789117570.776785:0:16222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457f800/0xf7565228e460ee23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.776802:0:16222:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178457f800/0xf7565228e460ee23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.776811:0:16222:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178457f800/0xf7565228e460ee23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117570.776832:0:16222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385515648:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789117570.776888:0:16222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117570.776930:0:16222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a167d840 going to sleep for 11 seconds 00000100:00100000:1.0:1789117570.782634:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385515648 00000100:00100000:1.0:1789117570.782648:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385515648 00000100:00100000:1.0:1789117570.782722:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789117570.782732:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:16222:x1876025385515648:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789117570.782749:0:14810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117570.782767:0:14810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178442f800/0xf7565228e460ee2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460ee23 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.782792:0:14810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178442f800/0xf7565228e460ee2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460ee23 expref: 17 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.782822:0:14810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178442f800/0xf7565228e460ee2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460ee23 expref: 17 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.782831:0:14810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442f800, rc 0) 00000100:00100000:1.0:1789117570.783047:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+17:16222:x1876025385515648:12345-0@lo:101:mount.lustre.0 Request processed in 316us (6157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117570.783059:0:16222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385515648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789117570.783061:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:3.0:1789117570.783100:0:16222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178457f800/0xf7565228e460ee23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ee2a expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.783114:0:16222:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178457f800/0xf7565228e460ee23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460ee2a expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789117570.784073:0:16222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789117570.785052:0:16222:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789117570.785335:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789117570.785386:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789117570.785550:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789117570.785721:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789117570.785809:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789117570.787349:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789117570.788313:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789117570.788326:0:16222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789117570.788927:0:16222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385515776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789117570.789040:0:16222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117570.789103:0:16222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785d600c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117570.789298:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385515776 00000100:00100000:0.0:1789117570.789308:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385515776 00000100:00100000:0.0:1789117570.789377:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789117570.789388:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+17:16222:x1876025385515776:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117570.790449:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+17:16222:x1876025385515776:12345-0@lo:501:mount.lustre.0 Request processed in 1058us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.790462:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789117570.790877:0:16222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385515776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789117570.790942:0:16222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385515904:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789117570.791132:0:16222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117570.791248:0:16222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785d600c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117570.791295:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385515904 00000100:00100000:2.0:1789117570.791301:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385515904 00000100:00100000:2.0:1789117570.791393:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789117570.791430:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+17:16222:x1876025385515904:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789117570.791825:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+17:16222:x1876025385515904:12345-0@lo:503:mount.lustre.0 Request processed in 397us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117570.791832:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789117570.791960:0:16222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385515904:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789117570.792577:0:16222:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789117570.792663:0:16222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385516032:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789117570.792725:0:16222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117570.796280:0:16222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785d600c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117570.796806:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385516032 00000100:00100000:1.0:1789117570.796821:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385516032 00000100:00100000:1.0:1789117570.797017:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789117570.797044:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+17:16222:x1876025385516032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789117570.797536:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+17:16222:x1876025385516032:12345-0@lo:502:mount.lustre.0 Request processed in 508us (4809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.797545:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789117570.798925:0:16222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385516032:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789117570.799312:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789117570.799386:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789117570.799480:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789117570.799534:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789117570.799570:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789117570.799600:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789117570.799643:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789117570.799675:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789117570.799748:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789117570.799817:0:16222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385516160:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789117570.799968:0:16222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.800165:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385516160 00000100:00100000:1.0:1789117570.800174:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385516160 00000100:00100000:1.0:1789117570.800223:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789117570.800233:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+17:16222:x1876025385516160:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789117570.800493:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+17:16222:x1876025385516160:12345-0@lo:502:mount.lustre.0 Request processed in 261us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.800502:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789117570.803256:0:16222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1785d600c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789117570.803315:0:16222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385516160:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789117570.803549:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789117570.803568:0:16222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1789117570.809023:0:16223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789117570.809041:0:16223:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789117570.809051:0:16223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117570.809054:0:16223:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789117570.809069:0:16223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789117570.809092:0:16223:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c17bfa41a48) 00000020:00000080:0.0:1789117570.809125:0:16223:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789117570.809132:0:16223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789117570.809259:0:16223:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c178548a000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789117570.809271:0:16223:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789117570.809281:0:16223:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf7565228e460ee38 00010000:00010000:1.0:1789117570.817936:0:16223:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1789117570.819023:0:16223:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00000100:00100000:2.0:1789117570.821539:0:3297:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789117555/real 1789117555] req@ffff9c17b87ea580 x1876025385511168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117570 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117570.821577:0:3297:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c17b87ea580 x1876025385511168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117570 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117570.821587:0:3297:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789117555/real 1789117555] req@ffff9c17b87ea1c0 x1876025385511296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117570 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117570.821598:0:3297:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c17b87ea1c0 x1876025385511296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789117570 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789117570.821621:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c1787216000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789117570.821668:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789117570.821673:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385511168:0@lo:8:kworker.0 00000100:00080000:2.0:1789117570.821680:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c17a7c11800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789117570.821686:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789117570.821690:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385511296:0@lo:8:kworker.0 00000100:00080000:3.0:1789117570.821866:0:15683:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789117570.821872:0:15683:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789117570.821876:0:15683:0:(import.c:65:import_set_state_nolock()) ffff9c1787216000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789117570.821881:0:15683:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 402 00000100:00080000:3.0:1789117570.821888:0:15683:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789117570.821896:0:15683:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c1787216000 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:3.0:1789117570.821937:0:15683:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c17c01cc000 x1876025385516288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789117570.822066:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385516288:0@lo:8:kworker.0 00000100:00100000:2.0:1789117570.822146:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789117570.822220:0:15683:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789117570.822224:0:15683:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789117570.822226:0:15683:0:(import.c:65:import_set_state_nolock()) ffff9c17a7c11800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789117570.822231:0:15683:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 402 00000100:00080000:3.0:1789117570.822233:0:15683:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789117570.822238:0:15683:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c17a7c11800 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:3.0:1789117570.822258:0:15683:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c17c01cf840 x1876025385516416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789117570.822347:0:15501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385516288 00000100:00100000:0.0:1789117570.822359:0:15501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385516288 00000100:00100000:0.0:1789117570.822442:0:15501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117570.822451:0:15501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876025385516288:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789117570.822498:0:15501:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 417 last 0 00000020:00000080:0.0:1789117570.822533:0:15501:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7565228e460ee3f 00002000:00100000:0.0:1789117570.822549:0:15501:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c1785488800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789117570.822554:0:15501:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789117570.822557:0:15501:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789117570.822852:0:15501:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789117570.822889:0:15501:0:(import.c:65:import_set_state_nolock()) ffff9c1787c28800 : changing import state from RECOVER to FULL 00080000:10000000:1.0:1789117570.823699:0:16223:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000100:00100000:2.0:1789117570.826857:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385516416:0@lo:8:kworker.0 00000100:00100000:1.0:1789117570.827390:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876025385516544:0@lo:400:kworker.0 00000100:00100000:1.0:1789117570.827461:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117570.827560:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.827668:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789117570.827675:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385516672:0@lo:400:kworker.0 00000100:00100000:1.0:1789117570.827704:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.827749:0:15504:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789117570.827758:0:15504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789117570.827980:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385516416 00000100:00100000:1.0:1789117570.827990:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385516416 00000100:00100000:1.0:1789117570.828107:0:16226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789117570.828117:0:16226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3297:x1876025385516416:12345-0@lo:8:kworker.0 00010000:02000000:1.0:1789117570.828141:0:16226:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-OST0001: Not available for connect from 0@lo (not set up) 00000100:00100000:0.0:1789117570.830872:0:15501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3297:x1876025385516288:12345-0@lo:8:kworker.0 Request processed in 8407us (8712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117570.830891:0:15501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117570.831457:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385516544 00000100:00100000:0.0:1789117570.831480:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385516544 00000100:00100000:0.0:1789117570.831544:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385516672 00000100:00100000:0.0:1789117570.831548:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385516672 00000100:00100000:0.0:1789117570.831575:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789117570.831585:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876025385516544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117570.831694:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876025385516544:12345-0@lo:400:kworker.0 Request processed in 109us (4231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117570.831701:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789117570.831715:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789117570.831723:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385516672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117570.831756:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385516672:12345-0@lo:400:kworker.0 Request processed in 34us (4051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117570.831763:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789117570.831817:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c17c01ccb40 x1876025385516672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117570.831853:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385516672:0@lo:400:kworker.0 00010000:00080000:0.0:1789117570.831872:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c17c01ce940 x1876025385516544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117570.831883:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876025385516544:0@lo:400:kworker.0 00010000:00080000:2.0:1789117570.836643:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c17c01cc000 x1876025385516288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789117590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117570.836663:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789117570.836676:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789117570.836688:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789117570.836696:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789117570.836700:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c1787216000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789117570.836717:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789117570.836723:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385516288:0@lo:8:kworker.0 00000004:00080000:2.0:1789117570.836818:0:14840:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1789117570.836843:0:14840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e9e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14840:1876025385516928:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789117570.836917:0:14840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117570.836952:0:14840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a167d840 going to sleep for 11 seconds 00000020:00000080:0.0:1789117570.837769:0:16223:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789117570.837787:0:16223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117570.837797:0:16223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117570.837799:0:16223:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789117570.837802:0:16223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117570.837808:0:16223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117570.837809:0:16223:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789117570.837812:0:16223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789117570.837814:0:16223:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789117570.837817:0:16223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117570.837819:0:16223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117570.837821:0:16223:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789117570.837823:0:16223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117570.837826:0:16223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117570.837827:0:16223:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789117570.837830:0:16223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789117570.837873:0:16223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117570.837876:0:16223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117570.837878:0:16223:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789117570.837882:0:16223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000100:00100000:3.0:1789117570.838210:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385516800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117570.838279:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117570.838478:0:15505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385516800 00000100:00100000:0.0:1789117570.838488:0:15505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385516800 00000100:00100000:3.0:1789117570.838513:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385516928 00000100:00100000:3.0:1789117570.838518:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385516928 00000100:00100000:3.0:1789117570.838552:0:15504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789117570.838552:0:15505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789117570.838562:0:15504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14840:x1876025385516928:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789117570.838562:0:15505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1876025385516800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789117570.838607:0:15505:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789117570.838669:0:15505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1876025385516800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117570.838677:0:15505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:0.0:1789117570.839524:0:14839:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789117570.839797:0:14839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 417969395446ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789117570.845872:0:16226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3297:x1876025385516416:12345-0@lo:8:kworker.0 Request processed in 17743us (18299us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789117570.845891:0:16226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789117570.850171:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c17a7c11800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789117570.850185:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789117570.850217:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385516416:0@lo:8:kworker.0 00000020:01000000:2.0:1789117570.850294:0:16222:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789117570.850340:0:16222:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789117570.850365:0:16222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457f800/0xf7565228e460ee23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ee2a expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.850378:0:16222:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178457f800/0xf7565228e460ee23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ee2a expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789117570.850389:0:16222:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c178548a000 from 1 10000000:01000000:2.0:1789117570.850393:0:16222:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789117570.850476:0:16222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460ee46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.850485:0:16222:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460ee46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.850499:0:16222:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460ee46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117570.850527:0:16222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385517056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789117570.850614:0:16222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117570.850669:0:16222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1783151180 going to sleep for 11 seconds 00000100:00100000:1.0:1789117570.852049:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385517056 00000100:00100000:1.0:1789117570.852063:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385517056 00000100:00100000:1.0:1789117570.852132:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789117570.852145:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+17:16222:x1876025385517056:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789117570.852165:0:14810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117570.852186:0:14810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178442f000/0xf7565228e460ee4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460ee46 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789117570.853023:0:15504:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789117570.853037:0:15504:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1789117570.853044:0:15504:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00010000:00010000:1.0:1789117570.853314:0:14810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178442f000/0xf7565228e460ee4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460ee46 expref: 18 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.853333:0:14810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178442f000/0xf7565228e460ee4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460ee46 expref: 18 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.853366:0:14810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442f000, rc 0) 00000100:00100000:1.0:1789117570.853494:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+18:16222:x1876025385517056:12345-0@lo:101:mount.lustre.0 Request processed in 1351us (2878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.853506:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789117570.853890:0:16222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385517056:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789117570.853918:0:16222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460ee46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ee4d expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.853930:0:16222:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460ee46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460ee4d expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789117570.854570:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1789117570.860388:0:16222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789117570.861499:0:16222:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789117570.868444:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789117570.868524:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789117570.868596:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789117570.868605:0:16222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789117570.868759:0:16222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385517184:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117570.868848:0:16222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789117570.871314:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c17b87e92c0 x1876025385516800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117570.871349:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385516800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117570.875291:0:16222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17981ca0c0 going to sleep for 11 seconds 00002000:00010000:3.0:1789117570.879671:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117570.879685:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098ed3c36/0xf7565228e460ee54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.879706:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789117570.879711:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117570.879718:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098ed3c36/0xf7565228e460ee54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.879738:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098ed3c36/0xf7565228e460ee54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.879750:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098ed3c36/0xf7565228e460ee54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.879759:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098ed3c36/0xf7565228e460ee54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.879787:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789117570.880250:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117570.880257:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a676096f/0xf7565228e460ee5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.880267:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789117570.880270:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117570.880275:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a676096f/0xf7565228e460ee5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.880284:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a676096f/0xf7565228e460ee5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.880292:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a676096f/0xf7565228e460ee5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.880301:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a676096f/0xf7565228e460ee5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.880317:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789117570.880725:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117570.880731:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b7f134f/0xf7565228e460ee62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.880739:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789117570.880747:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117570.880752:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b7f134f/0xf7565228e460ee62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.880762:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b7f134f/0xf7565228e460ee62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.880771:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b7f134f/0xf7565228e460ee62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.880778:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b7f134f/0xf7565228e460ee62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.880785:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789117570.881179:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117570.881185:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025d9bab8/0xf7565228e460ee69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.881194:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=418s v=(0 0) 00000100:00100000:0.0:1789117570.883346:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385517184 00000100:00100000:0.0:1789117570.883366:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385517184 00000100:00100000:0.0:1789117570.883452:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789117570.883464:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+18:16222:x1876025385517184:12345-0@lo:501:mount.lustre.0 00010000:00010000:3.0:1789117570.884287:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117570.884307:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025d9bab8/0xf7565228e460ee69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.884330:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025d9bab8/0xf7565228e460ee69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.884344:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025d9bab8/0xf7565228e460ee69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.884433:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025d9bab8/0xf7565228e460ee69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.884446:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1789117570.885455:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+18:16222:x1876025385517184:12345-0@lo:501:mount.lustre.0 Request processed in 1984us (16597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117570.885481:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789117570.886697:0:16222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385517184:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117570.886780:0:16222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385517312:0@lo:503:mount.lustre.0 00002000:00010000:3.0:1789117570.887474:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117570.887486:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b75708d/0xf7565228e460ee70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.887506:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789117570.887511:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117570.887518:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b75708d/0xf7565228e460ee70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.887535:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b75708d/0xf7565228e460ee70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.887547:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b75708d/0xf7565228e460ee70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.887556:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b75708d/0xf7565228e460ee70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.887568:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1789117570.888034:0:16222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.888094:0:16222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17981ca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117570.888838:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385517312 00000100:00100000:2.0:1789117570.888850:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385517312 00000100:00100000:2.0:1789117570.888909:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789117570.888920:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+18:16222:x1876025385517312:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789117570.889328:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+18:16222:x1876025385517312:12345-0@lo:503:mount.lustre.0 Request processed in 407us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117570.889338:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789117570.890076:0:16222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385517312:0@lo:503:mount.lustre.0 00002000:00010000:3.0:1789117570.892500:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117570.892515:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4c4d2e2/0xf7565228e460ee77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.892547:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789117570.892553:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117570.892561:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c4d2e2/0xf7565228e460ee77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.892579:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4c4d2e2/0xf7565228e460ee77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.892590:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4c4d2e2/0xf7565228e460ee77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.892598:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c4d2e2/0xf7565228e460ee77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.892611:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000040:00080000:1.0:1789117570.893382:0:16222:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789117570.893550:0:16222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385517440:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789117570.893654:0:16222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.893711:0:16222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17981ca0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117570.894340:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385517440 00000100:00100000:0.0:1789117570.894351:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385517440 00000100:00100000:0.0:1789117570.894425:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789117570.894437:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+18:16222:x1876025385517440:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789117570.894743:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+18:16222:x1876025385517440:12345-0@lo:502:mount.lustre.0 Request processed in 306us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117570.894752:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00002000:00010000:3.0:1789117570.895337:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117570.895349:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000654036f5/0xf7565228e460ee7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.895366:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789117570.895372:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117570.895380:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000654036f5/0xf7565228e460ee7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.895395:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000654036f5/0xf7565228e460ee7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.895440:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000654036f5/0xf7565228e460ee7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117570.895666:0:16222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385517440:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789117570.896063:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789117570.896122:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789117570.896169:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789117570.896235:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00010000:00010000:3.0:1789117570.897277:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000654036f5/0xf7565228e460ee7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.897296:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1789117570.897965:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117570.897974:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5483f6d/0xf7565228e460ee85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.897989:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789117570.897994:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117570.898001:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5483f6d/0xf7565228e460ee85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898017:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5483f6d/0xf7565228e460ee85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898027:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5483f6d/0xf7565228e460ee85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898035:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5483f6d/0xf7565228e460ee85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898057:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:3.0:1789117570.898515:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1789117570.898525:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098ed3c36/0xf7565228e460ee54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898534:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c7e00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117570.898539:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098ed3c36/0xf7565228e460ee54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898549:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098ed3c36/0xf7565228e460ee54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898572:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098ed3c36/0xf7565228e460ee54 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898581:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098ed3c36/0xf7565228e460ee54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898605:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1789117570.898609:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a676096f/0xf7565228e460ee5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898616:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c7800 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117570.898619:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a676096f/0xf7565228e460ee5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898676:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a676096f/0xf7565228e460ee5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898687:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a676096f/0xf7565228e460ee5b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898696:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a676096f/0xf7565228e460ee5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898710:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1789117570.898714:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b7f134f/0xf7565228e460ee62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898720:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c6800 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117570.898723:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b7f134f/0xf7565228e460ee62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898730:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b7f134f/0xf7565228e460ee62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898741:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b7f134f/0xf7565228e460ee62 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898748:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b7f134f/0xf7565228e460ee62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898775:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789117570.898839:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025d9bab8/0xf7565228e460ee69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898846:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c6e00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117570.898849:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025d9bab8/0xf7565228e460ee69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898856:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025d9bab8/0xf7565228e460ee69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898866:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025d9bab8/0xf7565228e460ee69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898873:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025d9bab8/0xf7565228e460ee69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898884:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789117570.898888:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b75708d/0xf7565228e460ee70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898894:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c7c00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117570.898897:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b75708d/0xf7565228e460ee70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898917:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b75708d/0xf7565228e460ee70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898928:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b75708d/0xf7565228e460ee70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898935:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b75708d/0xf7565228e460ee70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898948:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789117570.898952:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4c4d2e2/0xf7565228e460ee77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898959:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c6000 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117570.898962:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4c4d2e2/0xf7565228e460ee77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898969:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4c4d2e2/0xf7565228e460ee77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898978:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4c4d2e2/0xf7565228e460ee77 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.898984:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4c4d2e2/0xf7565228e460ee77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899007:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789117570.899011:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000654036f5/0xf7565228e460ee7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899019:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c7a00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117570.899022:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000654036f5/0xf7565228e460ee7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899029:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000654036f5/0xf7565228e460ee7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899039:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000654036f5/0xf7565228e460ee7e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899047:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000654036f5/0xf7565228e460ee7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899059:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117570.899062:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5483f6d/0xf7565228e460ee85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899069:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c7000 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117570.899073:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5483f6d/0xf7565228e460ee85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899092:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5483f6d/0xf7565228e460ee85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899102:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5483f6d/0xf7565228e460ee85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899110:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5483f6d/0xf7565228e460ee85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899125:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.899127:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.899129:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.899142:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117570.899608:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117570.899616:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009192ace3/0xf7565228e460ee8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899629:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789117570.899633:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117570.899639:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009192ace3/0xf7565228e460ee8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899650:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009192ace3/0xf7565228e460ee8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899659:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009192ace3/0xf7565228e460ee8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899674:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009192ace3/0xf7565228e460ee8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899691:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117570.899702:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117570.899706:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009192ace3/0xf7565228e460ee8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899713:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c6c00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117570.899716:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009192ace3/0xf7565228e460ee8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899725:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009192ace3/0xf7565228e460ee8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899738:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009192ace3/0xf7565228e460ee8c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899746:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009192ace3/0xf7565228e460ee8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.899760:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.899762:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.899763:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789117570.900016:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789117570.900099:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789117570.900142:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789117570.900183:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:1.0:1789117570.900235:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:1.0:1789117570.900272:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:1.0:1789117570.900324:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10256 00000100:00100000:1.0:1789117570.900396:0:16222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385517568:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789117570.900534:0:16222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.900593:0:16222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17981ca0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117570.904463:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385517568 00000100:00100000:1.0:1789117570.904492:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385517568 00000100:00100000:1.0:1789117570.904589:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789117570.904602:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+18:16222:x1876025385517568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789117570.904995:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+18:16222:x1876025385517568:12345-0@lo:502:mount.lustre.0 Request processed in 394us (4460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.905005:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789117570.905099:0:16222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385517568:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789117570.905255:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10480 00000040:00080000:1.0:1789117570.905273:0:16222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00002000:00010000:3.0:1789117570.911308:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117570.911332:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b6074a5/0xf7565228e460ee93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.911354:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789117570.911360:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117570.911367:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b6074a5/0xf7565228e460ee93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.911385:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b6074a5/0xf7565228e460ee93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.911423:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b6074a5/0xf7565228e460ee93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.911432:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b6074a5/0xf7565228e460ee93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.911456:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789117570.912327:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117570.912340:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b6074a5/0xf7565228e460ee93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.912351:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0c600 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:0.0:1789117570.912356:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b6074a5/0xf7565228e460ee93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.912382:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b6074a5/0xf7565228e460ee93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.912425:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b6074a5/0xf7565228e460ee93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.912433:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b6074a5/0xf7565228e460ee93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.912457:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117570.912459:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117570.912461:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789117570.912736:0:16229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117570.912749:0:16229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117570.912752:0:16229:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789117570.912761:0:16229:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c178548a000 00000020:00000080:0.0:1789117570.912764:0:16229:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789117570.912775:0:16229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117570.912778:0:16229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00002000:00010000:3.0:1789117570.913187:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000020:00000080:0.0:1789117570.913289:0:16229:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789117570.913296:0:16229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117570.913301:0:16229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117570.913303:0:16229:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789117570.913307:0:16229:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c178548a000 00000020:00000080:0.0:1789117570.913310:0:16229:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789117570.913385:0:16229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117570.913389:0:16229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117570.913391:0:16229:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789117570.913393:0:16229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117570.913431:0:16229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117570.913433:0:16229:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789117570.913437:0:16229:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c178548a000 00000020:00000080:0.0:1789117570.913440:0:16229:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789117570.913462:0:16229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117570.913475:0:16229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117570.913476:0:16229:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789117570.913479:0:16229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789117570.913482:0:16229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117570.913483:0:16229:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789117570.913487:0:16229:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c178548a000 00000020:00000080:0.0:1789117570.913489:0:16229:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789117570.913539:0:16229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789117570.913543:0:16229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789117570.913545:0:16229:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789117570.913548:0:16229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00010000:00010000:3.0:1789117570.913879:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e67be58a/0xf7565228e460ee9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.913899:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789117570.913904:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117570.913910:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e67be58a/0xf7565228e460ee9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.913926:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e67be58a/0xf7565228e460ee9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.913951:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e67be58a/0xf7565228e460ee9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.913959:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e67be58a/0xf7565228e460ee9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.913978:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117570.913994:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117570.914000:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e67be58a/0xf7565228e460ee9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.914009:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0ca00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117570.914013:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e67be58a/0xf7565228e460ee9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.914023:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e67be58a/0xf7565228e460ee9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.914041:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e67be58a/0xf7565228e460ee9a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.914049:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e67be58a/0xf7565228e460ee9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.914069:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.914076:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.914078:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117570.917696:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117570.917711:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e094020/0xf7565228e460eea1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.917731:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789117570.917736:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117570.917743:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e094020/0xf7565228e460eea1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.917761:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e094020/0xf7565228e460eea1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.917772:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e094020/0xf7565228e460eea1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.917779:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e094020/0xf7565228e460eea1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.917820:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117570.917839:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117570.917845:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e094020/0xf7565228e460eea1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.917853:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0d000 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117570.917858:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e094020/0xf7565228e460eea1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.917880:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e094020/0xf7565228e460eea1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.917902:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e094020/0xf7565228e460eea1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.917911:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e094020/0xf7565228e460eea1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.917935:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.917936:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.917938:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789117570.918897:0:16222:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789117570.918951:0:16222:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789117570.918974:0:16222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460ee46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ee4d expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.918987:0:16222:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460ee46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ee4d expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117570.919067:0:16222:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789117570.919071:0:16222:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c178548a000 10000000:01000000:1.0:1789117570.919074:0:16222:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c178548a000 10000000:01000000:1.0:1789117570.919079:0:16222:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789117570.919086:0:16222:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c178548a000 from 1 10000000:01000000:1.0:1789117570.919090:0:16222:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789117570.919137:0:16222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178442f600/0xf7565228e460eea8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.919145:0:16222:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178442f600/0xf7565228e460eea8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.919156:0:16222:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178442f600/0xf7565228e460eea8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117570.919185:0:16222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385517696:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789117570.919273:0:16222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.919325:0:16222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17981ca000 going to sleep for 11 seconds 00000100:00100000:2.0:1789117570.919632:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385517696 00000100:00100000:2.0:1789117570.919642:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385517696 00000100:00100000:2.0:1789117570.919703:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789117570.919713:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+18:16222:x1876025385517696:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789117570.919730:0:14810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117570.919747:0:14810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178457fa00/0xf7565228e460eeaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460eea8 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.919774:0:14810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178457fa00/0xf7565228e460eeaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460eea8 expref: 19 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.919784:0:14810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178457fa00/0xf7565228e460eeaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460eea8 expref: 19 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.919804:0:14810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457fa00, rc 0) 00000100:00100000:2.0:1789117570.919853:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:16222:x1876025385517696:12345-0@lo:101:mount.lustre.0 Request processed in 141us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117570.922139:0:16222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385517696:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789117570.922174:0:16222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178442f600/0xf7565228e460eea8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460eeaf expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117570.922188:0:16222:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178442f600/0xf7565228e460eea8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460eeaf expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789117570.922874:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117570.922885:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c01c46b8/0xf7565228e460eeb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.922901:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789117570.922906:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117570.922912:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c01c46b8/0xf7565228e460eeb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.922926:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c01c46b8/0xf7565228e460eeb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.922935:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c01c46b8/0xf7565228e460eeb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.922951:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c01c46b8/0xf7565228e460eeb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.922980:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117570.922996:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117570.923002:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c01c46b8/0xf7565228e460eeb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.923010:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0cc00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117570.923015:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c01c46b8/0xf7565228e460eeb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.923025:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c01c46b8/0xf7565228e460eeb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.923046:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c01c46b8/0xf7565228e460eeb6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.923054:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c01c46b8/0xf7565228e460eeb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.923075:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.923077:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.923078:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117570.927575:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000040:00080000:1.0:1789117570.929243:0:16222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789117570.929745:0:16222:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789117570.930042:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789117570.930099:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789117570.930134:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789117570.930186:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789117570.930223:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789117570.930267:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789117570.930302:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789117570.930336:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789117570.930386:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789117570.930460:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789117570.930512:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789117570.930562:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789117570.930620:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789117570.930657:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789117570.930723:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00002000:00010000:3.0:1789117570.931762:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117570.931786:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a56d54e/0xf7565228e460eebd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.931809:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789117570.931814:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117570.931822:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a56d54e/0xf7565228e460eebd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.931840:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a56d54e/0xf7565228e460eebd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.931853:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a56d54e/0xf7565228e460eebd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.931862:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a56d54e/0xf7565228e460eebd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.931900:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117570.932154:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117570.932163:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a56d54e/0xf7565228e460eebd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.932172:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0c200 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117570.932177:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a56d54e/0xf7565228e460eebd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.932188:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a56d54e/0xf7565228e460eebd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.932213:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a56d54e/0xf7565228e460eebd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.932222:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a56d54e/0xf7565228e460eebd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.932244:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117570.932246:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117570.932247:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117570.932441:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117570.932446:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc180d5d/0xf7565228e460eec4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.932455:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789117570.932458:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117570.932464:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc180d5d/0xf7565228e460eec4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.932489:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc180d5d/0xf7565228e460eec4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.932506:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc180d5d/0xf7565228e460eec4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.932513:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc180d5d/0xf7565228e460eec4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.932529:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117570.932539:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117570.932544:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc180d5d/0xf7565228e460eec4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.932551:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0d600 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117570.932554:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc180d5d/0xf7565228e460eec4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.932561:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc180d5d/0xf7565228e460eec4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.932572:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc180d5d/0xf7565228e460eec4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.932579:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc180d5d/0xf7565228e460eec4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.932592:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.932601:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.932603:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789117570.935016:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789117570.935080:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789117570.935150:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789117570.935187:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789117570.935241:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789117570.935292:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789117570.935326:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789117570.935358:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00002000:00010000:3.0:1789117570.935629:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117570.935640:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c01c46b8/0xf7565228e460eecb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.935661:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789117570.935666:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117570.935673:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c01c46b8/0xf7565228e460eecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.935689:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c01c46b8/0xf7565228e460eecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.935700:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c01c46b8/0xf7565228e460eecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.935707:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c01c46b8/0xf7565228e460eecb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.935731:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117570.935741:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117570.935749:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c01c46b8/0xf7565228e460eecb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.935762:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0cc00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117570.935767:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c01c46b8/0xf7565228e460eecb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.935776:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c01c46b8/0xf7565228e460eecb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.935915:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c01c46b8/0xf7565228e460eecb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.935923:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c01c46b8/0xf7565228e460eecb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.935943:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117570.935945:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117570.935947:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117570.936254:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117570.936259:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e094020/0xf7565228e460eed2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.936270:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789117570.936273:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117570.936276:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e094020/0xf7565228e460eed2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.936293:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e094020/0xf7565228e460eed2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.936302:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e094020/0xf7565228e460eed2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.936310:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e094020/0xf7565228e460eed2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.936325:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117570.936336:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117570.936341:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e094020/0xf7565228e460eed2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.936349:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0d000 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117570.936353:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e094020/0xf7565228e460eed2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.936362:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e094020/0xf7565228e460eed2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.936372:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e094020/0xf7565228e460eed2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.936380:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e094020/0xf7565228e460eed2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.936426:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.936428:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.936430:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117570.936874:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117570.936881:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e67be58a/0xf7565228e460eed9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.936891:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789117570.936894:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117570.936899:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e67be58a/0xf7565228e460eed9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.936909:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e67be58a/0xf7565228e460eed9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.936919:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e67be58a/0xf7565228e460eed9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.936926:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e67be58a/0xf7565228e460eed9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.936946:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117570.937285:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117570.937293:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e67be58a/0xf7565228e460eed9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.937301:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0ca00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117570.937305:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e67be58a/0xf7565228e460eed9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.937315:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e67be58a/0xf7565228e460eed9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.937336:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e67be58a/0xf7565228e460eed9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.937345:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e67be58a/0xf7565228e460eed9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789117570.937357:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117570.937363:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c472dab/0xf7565228e460eee0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.937382:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789117570.937385:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117570.937390:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c472dab/0xf7565228e460eee0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.937427:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c472dab/0xf7565228e460eee0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.937437:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c472dab/0xf7565228e460eee0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.937445:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c472dab/0xf7565228e460eee0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.937462:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117570.937483:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117570.937808:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117570.937810:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117570.937812:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117570.938013:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117570.938019:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef1b9e06/0xf7565228e460eee7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.938029:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789117570.938032:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117570.938037:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef1b9e06/0xf7565228e460eee7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.938046:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef1b9e06/0xf7565228e460eee7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789117570.938168:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789117570.938264:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789117570.942157:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789117570.942336:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789117570.942376:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789117570.942453:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789117570.942519:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1789117570.942556:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1789117570.942585:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1789117570.942616:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1789117570.942666:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1789117570.942715:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1789117570.942795:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1789117570.942838:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1789117570.942947:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1789117570.942955:0:16222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789117570.943089:0:16222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385517824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117570.943179:0:16222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.943251:0:16222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17981ca000 going to sleep for 11 seconds 00010000:00010000:3.0:1789117570.946640:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef1b9e06/0xf7565228e460eee7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.946670:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef1b9e06/0xf7565228e460eee7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.946796:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.946805:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c472dab/0xf7565228e460eee0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.946814:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0da00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117570.946819:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c472dab/0xf7565228e460eee0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.946832:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c472dab/0xf7565228e460eee0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.946858:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c472dab/0xf7565228e460eee0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.946866:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c472dab/0xf7565228e460eee0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.946891:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.946893:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.946905:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.946910:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.946912:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117570.950276:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385517824 00000100:00100000:2.0:1789117570.950297:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385517824 00000100:00100000:2.0:1789117570.950378:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789117570.950390:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b8621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:16222:x1876025385517824:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789117570.952031:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b8621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:16222:x1876025385517824:12345-0@lo:501:mount.lustre.0 Request processed in 1636us (8844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117570.952045:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789117570.953835:0:16222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385517824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789117570.953907:0:16222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385517952:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789117570.953986:0:16222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117570.954031:0:16222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17981ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1789117570.955446:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385517952 00000100:00100000:0.0:1789117570.955463:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385517952 00000100:00100000:0.0:1789117570.955545:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789117570.955556:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:16222:x1876025385517952:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789117570.956026:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:16222:x1876025385517952:12345-0@lo:503:mount.lustre.0 Request processed in 470us (2038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117570.956034:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789117570.956120:0:16222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385517952:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789117570.956981:0:16222:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789117570.957084:0:16222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385518080:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789117570.957163:0:16222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117570.957211:0:16222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17812ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1789117570.957240:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385518080 00000100:00100000:0.0:1789117570.957253:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385518080 00000100:00100000:0.0:1789117570.957295:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789117570.957303:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7f71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:16222:x1876025385518080:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789117570.957631:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7f71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:16222:x1876025385518080:12345-0@lo:502:mount.lustre.0 Request processed in 327us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117570.957640:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789117570.957708:0:16222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385518080:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789117570.957983:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789117570.958039:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789117570.958073:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789117570.958120:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00010000:00010000:2.0:1789117570.958571:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117570.958591:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117570.958601:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef1b9e06/0xf7565228e460eee7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.958616:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0c400 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117570.958620:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef1b9e06/0xf7565228e460eee7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.958643:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef1b9e06/0xf7565228e460eee7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.958667:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef1b9e06/0xf7565228e460eee7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.958675:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef1b9e06/0xf7565228e460eee7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.958700:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117570.958702:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117570.958704:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789117570.959333:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789117570.959342:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a983c53/0xf7565228e460eeee lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.959356:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1789117570.959361:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117570.959368:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a983c53/0xf7565228e460eeee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.959382:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a983c53/0xf7565228e460eeee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.959391:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a983c53/0xf7565228e460eeee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.961560:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a983c53/0xf7565228e460eeee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.961590:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789117570.962340:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789117570.962368:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460eef5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.962387:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1789117570.962393:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117570.962426:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460eef5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.962446:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460eef5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.962458:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460eef5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.962476:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460eef5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.962497:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789117570.962924:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789117570.962931:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aada93d/0xf7565228e460eefc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.962947:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1789117570.962950:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117570.962955:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003aada93d/0xf7565228e460eefc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.962965:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003aada93d/0xf7565228e460eefc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.962975:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aada93d/0xf7565228e460eefc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.962982:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003aada93d/0xf7565228e460eefc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.963000:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789117570.963020:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789117570.963027:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a983c53/0xf7565228e460eeee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.963036:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f000 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117570.963041:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a983c53/0xf7565228e460eeee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.963051:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a983c53/0xf7565228e460eeee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.963082:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a983c53/0xf7565228e460eeee lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.963091:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a983c53/0xf7565228e460eeee lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.963111:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789117570.963115:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460eef5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.963121:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e400 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117570.963125:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460eef5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.963132:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460eef5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.963142:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460eef5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.963149:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5c7f598/0xf7565228e460eef5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.963160:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117570.963163:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003aada93d/0xf7565228e460eefc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.963175:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f200 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117570.963179:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003aada93d/0xf7565228e460eefc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.963187:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003aada93d/0xf7565228e460eefc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.963197:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003aada93d/0xf7565228e460eefc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.963205:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003aada93d/0xf7565228e460eefc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.963218:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117570.963220:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117570.963222:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.964449:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.964461:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789117570.964758:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1789117570.968680:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789117570.968708:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f6bf7dc/0xf7565228e460ef03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.968731:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1789117570.968737:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117570.968745:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f6bf7dc/0xf7565228e460ef03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.968765:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f6bf7dc/0xf7565228e460ef03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.968797:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f6bf7dc/0xf7565228e460ef03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.968806:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f6bf7dc/0xf7565228e460ef03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.968827:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117570.968844:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117570.968851:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f6bf7dc/0xf7565228e460ef03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.968859:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457ee00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117570.968864:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f6bf7dc/0xf7565228e460ef03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.968874:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f6bf7dc/0xf7565228e460ef03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.968893:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f6bf7dc/0xf7565228e460ef03 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.968901:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f6bf7dc/0xf7565228e460ef03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.968921:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117570.968929:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117570.968931:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789117570.969449:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789117570.969457:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061eb7368/0xf7565228e460ef0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.969478:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1789117570.969481:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117570.969485:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061eb7368/0xf7565228e460ef0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.969494:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061eb7368/0xf7565228e460ef0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.969504:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061eb7368/0xf7565228e460ef0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.969511:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061eb7368/0xf7565228e460ef0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.969533:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117570.969549:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117570.969556:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061eb7368/0xf7565228e460ef0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.969564:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e800 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117570.969569:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061eb7368/0xf7565228e460ef0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789117570.969778:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789117570.969886:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789117570.969925:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00002000:00010000:2.0:1789117570.969945:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789117570.969951:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b0736e1/0xf7565228e460ef11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.969961:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1789117570.969965:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117570.969969:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b0736e1/0xf7565228e460ef11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789117570.969976:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00010000:00010000:2.0:1789117570.969985:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b0736e1/0xf7565228e460ef11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.969995:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b0736e1/0xf7565228e460ef11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.970003:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b0736e1/0xf7565228e460ef11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.970019:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:0.0:1789117570.970026:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789117570.970062:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789117570.970097:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789117570.970146:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789117570.970181:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789117570.970233:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789117570.970280:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789117570.970317:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789117570.970352:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789117570.970424:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00002000:00010000:2.0:1789117570.970441:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789117570.970447:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009029e49f/0xf7565228e460ef18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.970456:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1789117570.970460:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00000040:00080000:0.0:1789117570.970462:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00010000:00010000:2.0:1789117570.970476:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009029e49f/0xf7565228e460ef18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.970487:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009029e49f/0xf7565228e460ef18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.970496:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009029e49f/0xf7565228e460ef18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789117570.970510:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00010000:00010000:2.0:1789117570.970515:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009029e49f/0xf7565228e460ef18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.970530:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789117570.970544:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789117570.970550:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b0736e1/0xf7565228e460ef11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.970558:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457fe00 already unused, calling callback (ffffffffc16b5550) 00000040:00080000:0.0:1789117570.970558:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00010000:00010000:2.0:1789117570.970563:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b0736e1/0xf7565228e460ef11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.970572:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b0736e1/0xf7565228e460ef11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.970591:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b0736e1/0xf7565228e460ef11 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789117570.970591:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00010000:00010000:2.0:1789117570.970599:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b0736e1/0xf7565228e460ef11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.970618:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117570.970622:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009029e49f/0xf7565228e460ef18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789117570.970622:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00010000:00010000:2.0:1789117570.970637:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457ec00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117570.970641:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009029e49f/0xf7565228e460ef18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.970648:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009029e49f/0xf7565228e460ef18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.970660:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009029e49f/0xf7565228e460ef18 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.970667:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009029e49f/0xf7565228e460ef18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117570.970680:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117570.970682:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117570.970684:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789117570.970690:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789117570.970725:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789117570.970759:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789117570.970805:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789117570.970840:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00002000:00080000:2.0:1789117570.970863:0:15504:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000040:00080000:0.0:1789117570.970874:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789117570.970920:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789117570.970956:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789117570.970989:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789117570.971024:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789117570.971088:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789117570.971128:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789117570.971181:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789117570.971216:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789117570.971250:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789117570.971295:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789117570.971346:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789117570.971440:0:16222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385518208:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789117570.971553:0:16222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117570.971607:0:16222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17812ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1789117570.971657:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385518208 00000100:00100000:0.0:1789117570.971665:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385518208 00000100:00100000:0.0:1789117570.971717:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789117570.971727:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b9311450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:16222:x1876025385518208:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789117570.971970:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b9311450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:16222:x1876025385518208:12345-0@lo:502:mount.lustre.0 Request processed in 243us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117570.971979:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789117570.972049:0:16222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385518208:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789117570.972128:0:16222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789117570.972148:0:16222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00010000:00010000:3.0:1789117570.975812:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061eb7368/0xf7565228e460ef0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.975867:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061eb7368/0xf7565228e460ef0a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.975876:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061eb7368/0xf7565228e460ef0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117570.975921:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.975923:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.975927:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117570.975943:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117570.976556:0:15504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14840:x1876025385516928:12345-0@lo:5:osp-pre-0-0.0 Request processed in 137986us (139628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117570.976577:0:15504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117570.976649:0:14840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e9e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14840:1876025385516928:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789117570.976668:0:14840:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1789117570.978396:0:14840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e9e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14840:1876025385518336:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789117570.978825:0:14840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117570.978903:0:14840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17830ae3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789117570.978941:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385518336 00000100:00100000:2.0:1789117570.978950:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385518336 00000100:00100000:2.0:1789117570.979037:0:16226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789117570.979049:0:16226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14840:x1876025385518336:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789117570.979114:0:16226:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000020:01000004:0.0:1789117570.987386:0:16235:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789117570.987445:0:16235:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c1681d83490) 00000020:00000080:0.0:1789117570.987485:0:16235:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1789117570.987586:0:16235:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c178548a000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789117570.987591:0:16235:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c178548a000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789117570.987594:0:16235:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c178548a000 3 00010000:00080000:0.0:1789117570.987632:0:16235:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1681d89800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.137@tcp at head 00000100:00100000:2.0:1789117570.990191:0:16226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14840:x1876025385518336:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11131us (11355us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789117570.990211:0:16226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789117570.990299:0:14840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e9e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14840:1876025385518336:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789117570.990320:0:14840:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1789117570.990960:0:16235:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1789117570.993357:0:16235:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789117570.993531:0:16235:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789117570.993550:0:16235:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf7565228e460ef26 00000100:00080000:1.0:1789117570.993563:0:16235:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789117570.993571:0:16235:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c1681d89800 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:1.0:1789117570.993619:0:16235:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c17b85c03c0 x1876025385518464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789117570.993653:0:16235:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789117570.994027:0:15683:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789117570.994040:0:15683:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789117570.994042:0:15683:0:(import.c:65:import_set_state_nolock()) ffff9c17a7c11800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789117570.994047:0:15683:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 417 00000100:00080000:3.0:1789117570.994051:0:15683:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789117570.994056:0:15683:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c17a7c11800 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:3.0:1789117570.994075:0:15683:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c17c01ce580 x1876025385518592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789117570.994163:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385518848:0@lo:400:kworker.0 00000100:00100000:1.0:1789117570.994266:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117570.994353:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876025385518464:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789117570.994395:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117570.994444:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385518592:0@lo:8:kworker.0 00000100:00100000:2.0:1789117570.994483:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117570.994545:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385518720:0@lo:400:kworker.0 00000100:00100000:3.0:1789117570.994576:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117570.994619:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385518848 00000100:00100000:3.0:1789117570.994626:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385518848 00000100:00100000:3.0:1789117570.994669:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385518464 00000100:00100000:3.0:1789117570.994671:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385518464 00000100:00100000:3.0:1789117570.994681:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385518720 00000100:00100000:3.0:1789117570.994682:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385518720 00000040:00080000:2.0:1789117570.994693:0:16235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1789117570.994696:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789117570.994705:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385518848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117570.994807:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789117570.994817:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385518720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117570.994859:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385518720:12345-0@lo:400:kworker.0 Request processed in 44us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117570.994868:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789117570.994885:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789117570.994889:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1876025385518464:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789117570.994913:0:14819:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 418 last 0 00000020:00000080:0.0:1789117570.994953:0:14819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf7565228e460ef2d 00000004:00100000:0.0:1789117570.994972:0:14819:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789117570.995006:0:14819:0:(import.c:65:import_set_state_nolock()) ffff9c1681d8d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789117570.995053:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1876025385518464:12345-0@lo:38:llog_process_th.0 Request processed in 161us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117570.995060:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789117570.995086:0:15503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385518592 00000100:00100000:0.0:1789117570.995090:0:15503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385518592 00000100:00100000:0.0:1789117570.995110:0:15503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789117570.995115:0:15503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3297:x1876025385518592:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789117570.995164:0:15503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3297:x1876025385518592:12345-0@lo:8:kworker.0 Request processed in 48us (681us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789117570.995170:0:15503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789117570.995559:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c17b85c03c0 x1876025385518464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789117580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117570.995570:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789117570.995579:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789117570.995588:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789117570.995593:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789117570.995596:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c1681d89800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789117570.995603:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876025385518464:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789117570.995615:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789117570.995625:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c17a7c11800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789117570.995628:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789117570.995632:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385518592:0@lo:8:kworker.0 00000020:01000000:0.0:1789117570.998492:0:16222:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789117570.998569:0:16222:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789117570.998598:0:16222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178442f600/0xf7565228e460eea8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460eeaf expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117570.998614:0:16222:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178442f600/0xf7565228e460eea8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460eeaf expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789117570.998695:0:16222:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789117570.998697:0:16222:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789117570.998699:0:16222:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117570.998700:0:16222:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117570.998701:0:16222:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117570.998702:0:16222:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117570.998704:0:16222:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789117570.998706:0:16222:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117570.998707:0:16222:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789117570.998712:0:16222:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789117570.998715:0:16222:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789117570.998716:0:16222:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789117570.998717:0:16222:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789117570.998718:0:16222:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789117570.998719:0:16222:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789117570.998720:0:16222:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789117570.998721:0:16222:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789117570.998722:0:16222:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789117570.998723:0:16222:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789117570.998760:0:16222:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789117570.998787:0:16222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385518976:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789117570.998900:0:16222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117570.998946:0:16222:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178c4dcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789117570.999101:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385518976 00000100:00100000:2.0:1789117570.999110:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385518976 00000100:00100000:2.0:1789117570.999167:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789117570.999177:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b9312050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:16222:x1876025385518976:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789117570.999219:0:14809:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789117570.999237:0:14809:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1789117571.002742:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c17c01cc3c0 x1876025385518720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117571.002767:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385518720:0@lo:400:kworker.0 00000100:00100000:3.0:1789117571.003074:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385518848:12345-0@lo:400:kworker.0 Request processed in 8365us (8803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117571.003088:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789117571.005913:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c17c01cf480 x1876025385518848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789117571.005938:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385518848:0@lo:400:kworker.0 20000000:01000000:1.0:1789117571.106687:0:14809:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789117571.106719:0:14809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789117571.107771:0:14833:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789117571.107839:0:14833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789117571.107871:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c178457ec00/0xf7565228e460ef34 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117571.107894:0:14833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1787cbda00/0xf7565228e460ee0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460ee07 expref: 19 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117571.107904:0:14833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c178457ec00/0xf7565228e460ef34 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117571.107965:0:14833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1787cbda00/0xf7565228e460ee0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460ee07 expref: 19 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117571.107982:0:14833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1787cbda00/0xf7565228e460ee0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460ee07 expref: 19 pid: 14809 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117571.108060:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ead00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14833:1876025385519104:0@lo:104: 00000100:00100000:2.0:1789117571.108149:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117571.108972:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1783151c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789117571.109863:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385519104 00000100:00100000:1.0:1789117571.109876:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385519104 00000100:00100000:1.0:1789117571.109939:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789117571.110070:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+3:14833:x1876025385519104:12345-0@lo:104: 00010000:00010000:1.0:1789117571.110093:0:14800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c16829c6400/0xf7565228e460ee07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460ee0e expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117571.110193:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789117571.110199:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+3:14833:x1876025385519104:12345-0@lo:104: Request processed in 137us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117571.110208:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789117571.110240:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117571.110246:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c16829c6400/0xf7565228e460ee07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460ee0e expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117571.110255:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c6400 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:1.0:1789117571.110259:0:14805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c16829c6400/0xf7565228e460ee07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460ee0e expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117571.110269:0:14805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c16829c6400/0xf7565228e460ee07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460ee0e expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117571.110277:0:14805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c16829c6400/0xf7565228e460ee07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460ee0e expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117571.110283:0:14805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789117571.110328:0:14805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c16829c6400/0xf7565228e460ee07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460ee0e expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117571.110336:0:14805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117571.110380:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c16829c6400/0xf7565228e460ee07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460ee0e expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117571.110388:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c16829c6400/0xf7565228e460ee07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460ee0e expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117571.110429:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117571.110432:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117571.110434:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117571.110458:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3299:1876025385519232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117571.110515:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117571.110568:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385519232 00000100:00100000:1.0:1789117571.110574:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385519232 00010000:00010000:1.0:1789117571.110595:0:14804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1787cbda00/0xf7565228e460ee0e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460ee07 expref: 20 pid: 14809 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117571.110619:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789117571.110625:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+20:3299:x1876025385519232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117571.110637:0:14804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117571.110642:0:14804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1787cbda00/0xf7565228e460ee0e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460ee07 expref: 20 pid: 14809 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117571.110654:0:14804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1787cbda00/0xf7565228e460ee0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460ee07 expref: 20 pid: 14809 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117571.110674:0:14804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c178457ec00/0xf7565228e460ef34 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117571.110683:0:14804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178457ec00/0xf7565228e460ef34 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789117571.110712:0:14804:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002873498s 00010000:00010000:1.0:1789117571.110718:0:14804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178457ec00/0xf7565228e460ef34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117571.110726:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178457ec00/0xf7565228e460ef34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117571.110734:0:14804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c178457ec00/0xf7565228e460ef34 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117571.110741:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c178457ec00/0xf7565228e460ef34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117571.110746:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457ec00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:1.0:1789117571.110750:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c178457ec00/0xf7565228e460ef34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117571.110759:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c178457ec00/0xf7565228e460ef34 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117571.110768:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c178457ec00/0xf7565228e460ef34 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117571.110778:0:14804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117571.110809:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+20:3299:x1876025385519232:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117571.110816:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789117571.110865:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3299:1876025385519232:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789117571.110897:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1787cbda00/0xf7565228e460ee0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460ee07 expref: 19 pid: 14809 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117571.110917:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ead00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14833:1876025385519104:0@lo:104: 00010000:00010000:1.0:1789117571.110939:0:14833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c178457ec00/0xf7565228e460ef34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117571.111072:0:14833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c178457ec00/0xf7565228e460ef34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117571.111079:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c178457ec00/0xf7565228e460ef34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117571.111086:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178457ec00/0xf7565228e460ef34 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117571.121941:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b9312050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+18:16222:x1876025385518976:12345-0@lo:253:mount.lustre.0 Request processed in 122752us (123028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117571.122124:0:16222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:16222:1876025385518976:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789117571.122146:0:16222:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789117571.122150:0:16222:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789117571.122152:0:16222:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789117571.122153:0:16222:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789117571.122155:0:16222:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789117571.122156:0:16222:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789117571.122157:0:16222:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789117571.122159:0:16222:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789117571.122161:0:16222:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789117571.122163:0:16222:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789117571.122186:0:16222:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789117571.122892:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00080000:10000000:2.0:1789117571.128109:0:16222:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789117571.128347:0:16222:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789117571.128573:0:16222:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789117571.128729:0:16222:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789117571.128910:0:16222:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1789117571.129200:0:16222:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789117571.130445:0:16222:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789117571.222687:0:16222:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789117571.222700:0:16222:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789117571.222746:0:16222:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789117571.222841:0:16222:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.137@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789117571.222860:0:16222:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789117571.222917:0:16222:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1789117571.721174:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789117572.741541:0:14815:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789117572.741548:0:14815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1683d8b800 from 8 10000000:01000000:1.0:1789117572.741553:0:14815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789117572.741595:0:14815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178442fa00/0xf7565228e460ef3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117572.741607:0:14815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178442fa00/0xf7565228e460ef3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117572.741618:0:14815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178442fa00/0xf7565228e460ef3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117572.741645:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385519360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789117572.744578:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117572.751985:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117572.752036:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17ad1486c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117572.752554:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385519360 00000100:00100000:0.0:1789117572.752563:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385519360 00000100:00100000:0.0:1789117572.752615:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789117572.752624:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b9313050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+18:14815:x1876025385519360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117572.752639:0:14810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117572.752657:0:14810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1787cbc400/0xf7565228e460ef42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460ef3b expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117572.752695:0:14810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1787cbc400/0xf7565228e460ef42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460ef3b expref: 19 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117572.752706:0:14810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1787cbc400/0xf7565228e460ef42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460ef3b expref: 19 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117572.752716:0:14810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbc400, rc 0) 00000100:00100000:0.0:1789117572.752782:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b9313050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:14815:x1876025385519360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117572.752790:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789117572.753094:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385519360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117572.753111:0:14815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178442fa00/0xf7565228e460ef3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ef42 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117572.753120:0:14815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178442fa00/0xf7565228e460ef3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460ef42 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117572.753183:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385519488:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789117572.753221:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117572.753256:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17ad1486c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117572.754529:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385519488 00000100:00100000:0.0:1789117572.754539:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385519488 00000100:00100000:0.0:1789117572.754591:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789117572.754599:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b9313850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:14815:x1876025385519488:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789117572.754624:0:14809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789117572.754637:0:14809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789117572.754639:0:14809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789117572.754741:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b9313850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:14815:x1876025385519488:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 142us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117572.754748:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789117572.757928:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385519488:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789117572.758020:0:14815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789117572.758030:0:14815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178442fa00/0xf7565228e460ef3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ef42 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117572.758047:0:14815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178442fa00/0xf7565228e460ef3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460ef42 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117573.773900:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789117574.292827:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789117574.292844:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1789117574.789739:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117575.813642:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117576.262783:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385519616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117576.262841:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117576.262988:0:15505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385519616 00000100:00100000:0.0:1789117576.262996:0:15505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385519616 00000100:00100000:0.0:1789117576.263046:0:15505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789117576.263055:0:15505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385519616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789117576.263087:0:15505:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789117576.263133:0:15505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385519616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117576.263141:0:15505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789117576.263161:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117576.263192:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789117576.263217:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385519616:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789117576.263919:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789117576.263924:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789117576.263928:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c17a7c11800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789117576.263946:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c17a7c11800 using connection 192.168.206.137@tcp/0@lo 00000100:00100000:3.0:1789117576.263967:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c17c01ced00 x1876025385519872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789117576.264023:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3301:1876025385519744:0@lo:400:kworker.0 00000100:00100000:3.0:1789117576.264067:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117576.264100:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117576.264107:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876025385520256:0@lo:400:kworker.0 00000100:00100000:3.0:1789117576.264137:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117576.264164:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385519872:0@lo:8:kworker.0 00000100:00100000:3.0:1789117576.264188:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117576.264220:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876025385520000:0@lo:400:kworker.0 00000100:00100000:3.0:1789117576.264242:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117576.264261:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117576.264266:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385520128:0@lo:400:kworker.0 00000100:00100000:3.0:1789117576.264286:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117576.264311:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385519744 00000100:00100000:3.0:1789117576.264316:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385519744 00000100:00100000:3.0:1789117576.264349:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789117576.264357:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b9312c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:3301:x1876025385519744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117576.264395:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b9312c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:3301:x1876025385519744:12345-0@lo:400:kworker.0 Request processed in 39us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117576.264425:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789117576.264469:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385520256 00000100:00100000:3.0:1789117576.264540:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385520256 00000100:00100000:3.0:1789117576.264577:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385520000 00000100:00100000:3.0:1789117576.264581:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385520000 00000100:00100000:3.0:1789117576.264602:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385520128 00000100:00100000:3.0:1789117576.264605:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385520128 00000100:00100000:3.0:1789117576.264618:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789117576.264623:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876025385520256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117576.264658:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876025385520256:12345-0@lo:400:kworker.0 Request processed in 35us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117576.264665:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789117576.264678:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789117576.264684:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876025385520000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117576.264715:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876025385520000:12345-0@lo:400:kworker.0 Request processed in 32us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117576.264721:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789117576.264733:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789117576.264739:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385520128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117576.264766:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385520128:12345-0@lo:400:kworker.0 Request processed in 27us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117576.264772:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789117576.264807:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c01cc3c0 x1876025385520256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117576.264819:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876025385520256:0@lo:400:kworker.0 00000100:00100000:3.0:1789117576.264830:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3301:1876025385519744:0@lo:400:kworker.0 00000100:00080000:3.0:1789117576.264850:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789117576.264869:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c01cf480 x1876025385520128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117576.264878:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385520128:0@lo:400:kworker.0 00010000:00080000:3.0:1789117576.264900:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c01cd680 x1876025385520000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789117592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117576.264908:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876025385520000:0@lo:400:kworker.0 00000100:00100000:1.0:1789117576.265337:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385519872 00000100:00100000:1.0:1789117576.265343:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385519872 00000100:00100000:1.0:1789117576.265374:0:15504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789117576.265380:0:15504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3297:x1876025385519872:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789117576.265427:0:15504:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:1.0:1789117576.265464:0:15504:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7565228e460ef49 00002000:00100000:1.0:1789117576.265592:0:15504:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c17bb972000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789117576.265597:0:15504:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789117576.265600:0:15504:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789117576.265880:0:15504:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789117576.265904:0:15504:0:(import.c:65:import_set_state_nolock()) ffff9c17bb977800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789117576.265970:0:15504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3297:x1876025385519872:12345-0@lo:8:kworker.0 Request processed in 588us (1780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117576.265977:0:15504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789117576.266602:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c01ced00 x1876025385519872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789117601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789117576.266617:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789117576.266624:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789117576.266629:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789117576.266631:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9c17a7c11800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789117576.266644:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789117576.266649:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876025385519872:0@lo:8:kworker.0 00000004:00080000:2.0:1789117576.266673:0:14841:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789117576.266983:0:14841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 423396582138ns, next at 0ns, rc = 0 00000004:00080000:3.0:1789117576.267144:0:14842:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1789117576.267165:0:14842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14842:1876025385520512:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789117576.267211:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117576.267240:0:14842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17ad148180 going to sleep for 11 seconds 00000100:00100000:3.0:1789117576.267255:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385520384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117576.267278:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117576.267309:0:15503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385520512 00000100:00100000:3.0:1789117576.267313:0:15503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385520512 00000100:00100000:3.0:1789117576.267353:0:15503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789117576.267361:0:15503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14842:x1876025385520512:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1789117576.269694:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117576.269717:0:15505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385520384 00000100:00100000:2.0:1789117576.269725:0:15505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385520384 00000100:00100000:2.0:1789117576.269777:0:15505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789117576.269786:0:15505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1876025385520384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789117576.269819:0:15505:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789117576.269894:0:15505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1876025385520384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (2613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117576.269912:0:15505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789117576.270137:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c17c01cd680 x1876025385520384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789117592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117576.270159:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385520384:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1789117576.279017:0:15503:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789117576.279029:0:15503:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1789117576.279035:0:15503:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1789117576.297992:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.298006:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e094020/0xf7565228e460ef50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.298022:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.298026:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.298033:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e094020/0xf7565228e460ef50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.298053:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e094020/0xf7565228e460ef50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.298072:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e094020/0xf7565228e460ef50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.298079:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e094020/0xf7565228e460ef50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.298101:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117576.298121:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117576.298126:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e094020/0xf7565228e460ef50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.298134:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0d000 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117576.298139:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e094020/0xf7565228e460ef50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.298148:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e094020/0xf7565228e460ef50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.298166:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e094020/0xf7565228e460ef50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.298174:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e094020/0xf7565228e460ef50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.298192:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.298199:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.298201:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117576.298950:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.298957:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c472dab/0xf7565228e460ef57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.298967:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.298970:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.298974:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c472dab/0xf7565228e460ef57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.298983:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c472dab/0xf7565228e460ef57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.298991:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c472dab/0xf7565228e460ef57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.298998:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c472dab/0xf7565228e460ef57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.299016:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117576.299028:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117576.299032:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c472dab/0xf7565228e460ef57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.299040:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0da00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117576.299043:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c472dab/0xf7565228e460ef57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.299063:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c472dab/0xf7565228e460ef57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.299075:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c472dab/0xf7565228e460ef57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.299083:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c472dab/0xf7565228e460ef57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.299096:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.299098:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.299100:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117576.299528:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.299534:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc180d5d/0xf7565228e460ef5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.299543:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.299546:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.299551:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc180d5d/0xf7565228e460ef5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.299561:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc180d5d/0xf7565228e460ef5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.299568:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc180d5d/0xf7565228e460ef5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.299582:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc180d5d/0xf7565228e460ef5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.299597:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117576.299606:0:16231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117576.299610:0:16231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc180d5d/0xf7565228e460ef5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.299617:0:16231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0d600 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117576.299620:0:16231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc180d5d/0xf7565228e460ef5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.299629:0:16231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc180d5d/0xf7565228e460ef5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.299641:0:16231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc180d5d/0xf7565228e460ef5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.299647:0:16231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc180d5d/0xf7565228e460ef5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.299660:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.299662:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.299663:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117576.300041:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.300054:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf5f272f/0xf7565228e460ef65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.300063:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.300066:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.300069:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf5f272f/0xf7565228e460ef65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.300078:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf5f272f/0xf7565228e460ef65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.300086:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf5f272f/0xf7565228e460ef65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.301200:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf5f272f/0xf7565228e460ef65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.301228:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789117576.301569:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117576.301576:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf5f272f/0xf7565228e460ef65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117576.301584:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0d800 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:0.0:1789117576.301588:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf5f272f/0xf7565228e460ef65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117576.301597:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf5f272f/0xf7565228e460ef65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117576.301623:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf5f272f/0xf7565228e460ef65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117576.301630:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf5f272f/0xf7565228e460ef65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117576.301648:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117576.301649:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117576.301651:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117576.302062:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.302069:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7437243/0xf7565228e460ef6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.302080:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.302084:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.302089:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7437243/0xf7565228e460ef6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.302101:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7437243/0xf7565228e460ef6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.302116:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7437243/0xf7565228e460ef6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.302124:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7437243/0xf7565228e460ef6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.302139:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117576.302148:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117576.302152:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7437243/0xf7565228e460ef6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.302159:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0de00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117576.302163:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7437243/0xf7565228e460ef6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.302171:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7437243/0xf7565228e460ef6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.302183:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7437243/0xf7565228e460ef6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.302188:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7437243/0xf7565228e460ef6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.302201:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.302207:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.302209:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117576.302656:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.302663:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c24caa32/0xf7565228e460ef73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.302671:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.302675:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.302679:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c24caa32/0xf7565228e460ef73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.302688:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c24caa32/0xf7565228e460ef73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.302697:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c24caa32/0xf7565228e460ef73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.302704:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c24caa32/0xf7565228e460ef73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.302718:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117576.302728:0:16231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117576.302732:0:16231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c24caa32/0xf7565228e460ef73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.302738:0:16231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0c800 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117576.302741:0:16231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c24caa32/0xf7565228e460ef73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.302758:0:16231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c24caa32/0xf7565228e460ef73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.302770:0:16231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c24caa32/0xf7565228e460ef73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.302776:0:16231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c24caa32/0xf7565228e460ef73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.302789:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.302790:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.302792:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117576.303142:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.303148:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072c362b6/0xf7565228e460ef7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.303157:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.303160:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.303163:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072c362b6/0xf7565228e460ef7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.303172:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072c362b6/0xf7565228e460ef7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.303179:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072c362b6/0xf7565228e460ef7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.303192:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072c362b6/0xf7565228e460ef7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.303205:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117576.303214:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117576.303218:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072c362b6/0xf7565228e460ef7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.303224:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0ce00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117576.303227:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072c362b6/0xf7565228e460ef7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.303234:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072c362b6/0xf7565228e460ef7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.303245:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072c362b6/0xf7565228e460ef7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.303251:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072c362b6/0xf7565228e460ef7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.303262:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.303264:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.303266:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117576.303685:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.303697:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cfba96b/0xf7565228e460ef81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.303705:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.303708:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.303712:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cfba96b/0xf7565228e460ef81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.303721:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cfba96b/0xf7565228e460ef81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.303728:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cfba96b/0xf7565228e460ef81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.303734:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cfba96b/0xf7565228e460ef81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.303748:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117576.303756:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117576.303761:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cfba96b/0xf7565228e460ef81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.303768:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0dc00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117576.303771:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cfba96b/0xf7565228e460ef81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.303779:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cfba96b/0xf7565228e460ef81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.303797:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cfba96b/0xf7565228e460ef81 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.303805:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cfba96b/0xf7565228e460ef81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.303819:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.303820:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.303822:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117576.304205:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.304211:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eb9cbfd/0xf7565228e460ef88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.304220:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.304223:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.304226:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eb9cbfd/0xf7565228e460ef88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.304236:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eb9cbfd/0xf7565228e460ef88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.304244:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eb9cbfd/0xf7565228e460ef88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.304251:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eb9cbfd/0xf7565228e460ef88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.304274:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117576.304283:0:16231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117576.304287:0:16231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eb9cbfd/0xf7565228e460ef88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.304294:0:16231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0c000 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117576.304546:0:16231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eb9cbfd/0xf7565228e460ef88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.304557:0:16231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eb9cbfd/0xf7565228e460ef88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.304570:0:16231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eb9cbfd/0xf7565228e460ef88 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.304577:0:16231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eb9cbfd/0xf7565228e460ef88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.304589:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.304591:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.304593:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117576.307250:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.307265:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e094020/0xf7565228e460ef8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.307280:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.307291:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.307297:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e094020/0xf7565228e460ef8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.307312:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e094020/0xf7565228e460ef8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.307322:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e094020/0xf7565228e460ef8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.307329:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e094020/0xf7565228e460ef8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.307352:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789117576.307862:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789117576.307870:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e094020/0xf7565228e460ef8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117576.307879:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0d000 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:0.0:1789117576.307883:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e094020/0xf7565228e460ef8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117576.307892:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e094020/0xf7565228e460ef8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117576.307909:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e094020/0xf7565228e460ef8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117576.307917:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e094020/0xf7565228e460ef8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117576.307947:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117576.307949:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117576.307951:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117576.309824:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.309837:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000993ae961/0xf7565228e460ef96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.309852:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.309856:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.309862:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000993ae961/0xf7565228e460ef96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.309874:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000993ae961/0xf7565228e460ef96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.309884:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000993ae961/0xf7565228e460ef96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.309896:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000993ae961/0xf7565228e460ef96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.309911:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117576.309923:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117576.309928:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000993ae961/0xf7565228e460ef96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.309935:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0d200 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117576.309939:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000993ae961/0xf7565228e460ef96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.309948:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000993ae961/0xf7565228e460ef96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.309962:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000993ae961/0xf7565228e460ef96 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.309969:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000993ae961/0xf7565228e460ef96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.309985:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.309986:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.309988:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117576.310513:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.310527:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072c362b6/0xf7565228e460ef9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.310536:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.310539:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.310543:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072c362b6/0xf7565228e460ef9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.310553:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072c362b6/0xf7565228e460ef9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.310562:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072c362b6/0xf7565228e460ef9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.310569:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072c362b6/0xf7565228e460ef9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.310582:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117576.310591:0:16231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117576.310595:0:16231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072c362b6/0xf7565228e460ef9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.310601:0:16231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0ce00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117576.310605:0:16231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072c362b6/0xf7565228e460ef9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.310613:0:16231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072c362b6/0xf7565228e460ef9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.310629:0:16231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072c362b6/0xf7565228e460ef9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.310636:0:16231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072c362b6/0xf7565228e460ef9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.310647:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.310649:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.310650:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117576.311391:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.311418:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c24caa32/0xf7565228e460efa4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.311430:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.311433:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.311449:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c24caa32/0xf7565228e460efa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.311459:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c24caa32/0xf7565228e460efa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.311467:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c24caa32/0xf7565228e460efa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.311531:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c24caa32/0xf7565228e460efa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.311561:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789117576.311967:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.311974:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7437243/0xf7565228e460efab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.311983:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.311986:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.311990:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7437243/0xf7565228e460efab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.312000:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7437243/0xf7565228e460efab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.312008:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7437243/0xf7565228e460efab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.312016:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7437243/0xf7565228e460efab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.312030:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789117576.312040:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789117576.312044:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c24caa32/0xf7565228e460efa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.312051:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0c800 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117576.312060:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c24caa32/0xf7565228e460efa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.312070:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c24caa32/0xf7565228e460efa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.312083:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c24caa32/0xf7565228e460efa4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.312090:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c24caa32/0xf7565228e460efa4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.312105:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117576.312109:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7437243/0xf7565228e460efab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.312115:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0de00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117576.312118:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7437243/0xf7565228e460efab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.312125:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7437243/0xf7565228e460efab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.312134:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7437243/0xf7565228e460efab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.312140:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7437243/0xf7565228e460efab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.312156:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.312158:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.312160:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117576.312483:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117576.312970:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.312978:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc180d5d/0xf7565228e460efb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.312987:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.312991:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.312995:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc180d5d/0xf7565228e460efb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.313004:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc180d5d/0xf7565228e460efb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.313012:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc180d5d/0xf7565228e460efb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.313019:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc180d5d/0xf7565228e460efb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.313038:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117576.313045:0:16231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117576.313051:0:16231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc180d5d/0xf7565228e460efb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.313059:0:16231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0d600 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117576.313063:0:16231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc180d5d/0xf7565228e460efb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.313083:0:16231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc180d5d/0xf7565228e460efb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.313100:0:16231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc180d5d/0xf7565228e460efb2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.313107:0:16231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc180d5d/0xf7565228e460efb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.313123:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117576.313125:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117576.313126:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117576.313633:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.313641:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c472dab/0xf7565228e460efb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.313663:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.313666:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.313670:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c472dab/0xf7565228e460efb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.313679:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c472dab/0xf7565228e460efb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.313686:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c472dab/0xf7565228e460efb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.313692:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c472dab/0xf7565228e460efb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.313713:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117576.314039:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117576.314051:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c472dab/0xf7565228e460efb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.314059:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0da00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117576.314063:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c472dab/0xf7565228e460efb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.314071:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c472dab/0xf7565228e460efb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.314084:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c472dab/0xf7565228e460efb9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.314092:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c472dab/0xf7565228e460efb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.314107:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117576.314109:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117576.314110:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117576.314154:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.314159:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096703640/0xf7565228e460efc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.314168:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.314171:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.314175:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096703640/0xf7565228e460efc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.314184:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096703640/0xf7565228e460efc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.314204:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096703640/0xf7565228e460efc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.314210:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096703640/0xf7565228e460efc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.314232:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789117576.314744:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117576.314825:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096703640/0xf7565228e460efc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.314836:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0d400 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117576.314839:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096703640/0xf7565228e460efc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.314860:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096703640/0xf7565228e460efc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.314873:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096703640/0xf7565228e460efc0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.314881:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096703640/0xf7565228e460efc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.314897:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117576.314899:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117576.314901:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117576.315130:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.315137:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef1b9e06/0xf7565228e460efc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.315146:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.315149:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.315154:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef1b9e06/0xf7565228e460efc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.315164:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef1b9e06/0xf7565228e460efc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.315171:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef1b9e06/0xf7565228e460efc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.315178:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef1b9e06/0xf7565228e460efc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.315241:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789117576.318156:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.318170:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e67be58a/0xf7565228e460efce lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.318188:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.318193:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.318200:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e67be58a/0xf7565228e460efce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.318213:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e67be58a/0xf7565228e460efce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.318223:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e67be58a/0xf7565228e460efce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.318231:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e67be58a/0xf7565228e460efce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.319869:0:16231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789117576.319884:0:16231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef1b9e06/0xf7565228e460efc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.319898:0:16231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0c400 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117576.319904:0:16231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef1b9e06/0xf7565228e460efc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.319915:0:16231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef1b9e06/0xf7565228e460efc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.319935:0:16231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef1b9e06/0xf7565228e460efc7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.319957:0:16231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef1b9e06/0xf7565228e460efc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.320047:0:16231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117576.320051:0:16231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e67be58a/0xf7565228e460efce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.320058:0:16231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0ca00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117576.320061:0:16231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e67be58a/0xf7565228e460efce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.320069:0:16231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e67be58a/0xf7565228e460efce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.320080:0:16231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e67be58a/0xf7565228e460efce lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117576.320087:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117576.320089:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117576.320091:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.321603:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789117576.321616:0:15503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e67be58a/0xf7565228e460efce lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789117576.322202:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.322210:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eb9cbfd/0xf7565228e460efd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.322239:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.322244:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.322250:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eb9cbfd/0xf7565228e460efd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.322264:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eb9cbfd/0xf7565228e460efd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.322273:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eb9cbfd/0xf7565228e460efd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.322281:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eb9cbfd/0xf7565228e460efd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.322299:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789117576.322889:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.322895:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cfba96b/0xf7565228e460efdc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.322904:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.322908:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.322912:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cfba96b/0xf7565228e460efdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.322922:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cfba96b/0xf7565228e460efdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.322941:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cfba96b/0xf7565228e460efdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.322949:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cfba96b/0xf7565228e460efdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.322970:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789117576.322987:0:16231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789117576.322993:0:16231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eb9cbfd/0xf7565228e460efd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.323001:0:16231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0c000 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117576.323005:0:16231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eb9cbfd/0xf7565228e460efd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.323015:0:16231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eb9cbfd/0xf7565228e460efd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.323032:0:16231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eb9cbfd/0xf7565228e460efd5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.323040:0:16231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eb9cbfd/0xf7565228e460efd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.323057:0:16231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117576.323066:0:16231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cfba96b/0xf7565228e460efdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.323073:0:16231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0dc00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117576.323076:0:16231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cfba96b/0xf7565228e460efdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.323085:0:16231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cfba96b/0xf7565228e460efdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.323095:0:16231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cfba96b/0xf7565228e460efdc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.323101:0:16231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cfba96b/0xf7565228e460efdc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.323115:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.323116:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.323118:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117576.323733:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.323740:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c01c46b8/0xf7565228e460efe3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.323815:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.323820:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.323825:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c01c46b8/0xf7565228e460efe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.323847:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c01c46b8/0xf7565228e460efe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.323856:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c01c46b8/0xf7565228e460efe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.323864:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c01c46b8/0xf7565228e460efe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.323880:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789117576.323892:0:16231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789117576.323896:0:16231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c01c46b8/0xf7565228e460efe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.323904:0:16231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0cc00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117576.323908:0:16231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c01c46b8/0xf7565228e460efe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.323916:0:16231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c01c46b8/0xf7565228e460efe3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.323928:0:16231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c01c46b8/0xf7565228e460efe3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.323935:0:16231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c01c46b8/0xf7565228e460efe3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.323959:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.323960:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.323962:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789117576.324392:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.324422:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a56d54e/0xf7565228e460efea lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.324432:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.324447:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.324452:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a56d54e/0xf7565228e460efea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.324462:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a56d54e/0xf7565228e460efea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.324470:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a56d54e/0xf7565228e460efea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.326661:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a56d54e/0xf7565228e460efea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.326734:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789117576.330324:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.330335:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b6074a5/0xf7565228e460eff1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.330360:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.330365:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.330371:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b6074a5/0xf7565228e460eff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.330386:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b6074a5/0xf7565228e460eff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.330395:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b6074a5/0xf7565228e460eff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.330423:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b6074a5/0xf7565228e460eff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117576.333894:0:16231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789117576.333910:0:16231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a56d54e/0xf7565228e460efea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117576.333924:0:16231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0c200 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:0.0:1789117576.333929:0:16231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a56d54e/0xf7565228e460efea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117576.333940:0:16231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a56d54e/0xf7565228e460efea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117576.333961:0:16231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a56d54e/0xf7565228e460efea lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117576.333968:0:16231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a56d54e/0xf7565228e460efea lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.334056:0:16231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117576.334062:0:16231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b6074a5/0xf7565228e460eff1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.334069:0:16231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0c600 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:1.0:1789117576.334073:0:16231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b6074a5/0xf7565228e460eff1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.334095:0:16231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b6074a5/0xf7565228e460eff1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.334108:0:16231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b6074a5/0xf7565228e460eff1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.334117:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117576.334119:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117576.334120:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117576.334184:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789117576.334194:0:15503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b6074a5/0xf7565228e460eff1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789117576.334865:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.334873:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf5f272f/0xf7565228e460eff8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.334884:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.334889:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.334894:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf5f272f/0xf7565228e460eff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.334917:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf5f272f/0xf7565228e460eff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.334926:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf5f272f/0xf7565228e460eff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.334933:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf5f272f/0xf7565228e460eff8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.334942:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789117576.335336:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.335343:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d26c4eb8/0xf7565228e460efff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.335351:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.335354:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.335358:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d26c4eb8/0xf7565228e460efff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.335367:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d26c4eb8/0xf7565228e460efff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.335375:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d26c4eb8/0xf7565228e460efff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.335393:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d26c4eb8/0xf7565228e460efff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.335427:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789117576.335837:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.335843:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009192ace3/0xf7565228e460f006 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.335852:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.335855:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.335859:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009192ace3/0xf7565228e460f006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.335868:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009192ace3/0xf7565228e460f006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.335877:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009192ace3/0xf7565228e460f006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.335883:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009192ace3/0xf7565228e460f006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.335891:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789117576.336257:0:15503:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789117576.336263:0:15503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5483f6d/0xf7565228e460f00d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.336276:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789117576.336279:0:15503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117576.336283:0:15503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5483f6d/0xf7565228e460f00d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.336292:0:15503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5483f6d/0xf7565228e460f00d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.336299:0:15503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5483f6d/0xf7565228e460f00d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.336306:0:15503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5483f6d/0xf7565228e460f00d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117576.336314:0:15503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:3.0:1789117576.336530:0:15503:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1789117576.336634:0:15503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14842:x1876025385520512:12345-0@lo:5:osp-pre-1-0.0 Request processed in 69270us (69418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117576.336644:0:15503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789117576.336832:0:16231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789117576.336840:0:16231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf5f272f/0xf7565228e460eff8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.336848:0:16231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17a4a0d800 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:1.0:1789117576.336852:0:16231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf5f272f/0xf7565228e460eff8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.336861:0:16231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf5f272f/0xf7565228e460eff8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.336876:0:16231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf5f272f/0xf7565228e460eff8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.336883:0:16231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf5f272f/0xf7565228e460eff8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.336916:0:16231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789117576.336919:0:16231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d26c4eb8/0xf7565228e460efff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.336925:0:16231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c6400 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:1.0:1789117576.336928:0:16231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d26c4eb8/0xf7565228e460efff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.336936:0:16231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d26c4eb8/0xf7565228e460efff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.336946:0:16231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d26c4eb8/0xf7565228e460efff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.336953:0:16231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d26c4eb8/0xf7565228e460efff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.336963:0:16231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789117576.336967:0:16231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009192ace3/0xf7565228e460f006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.336973:0:16231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c6c00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:1.0:1789117576.336975:0:16231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009192ace3/0xf7565228e460f006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.337000:0:16231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009192ace3/0xf7565228e460f006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.337010:0:16231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009192ace3/0xf7565228e460f006 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.337017:0:16231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009192ace3/0xf7565228e460f006 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.337029:0:16231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117576.337031:0:16231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5483f6d/0xf7565228e460f00d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.337038:0:16231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c7000 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:1.0:1789117576.337041:0:16231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5483f6d/0xf7565228e460f00d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.337048:0:16231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5483f6d/0xf7565228e460f00d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.337056:0:16231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5483f6d/0xf7565228e460f00d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.337062:0:16231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5483f6d/0xf7565228e460f00d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117576.337085:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117576.337087:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117576.337088:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117576.337183:0:14842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01cf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14842:1876025385520512:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789117576.337198:0:14842:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1789117576.337240:0:14842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02561c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14842:1876025385520640:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789117576.337279:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117576.337330:0:14842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17906d0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789117576.337378:0:16226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385520640 00000100:00100000:1.0:1789117576.337384:0:16226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385520640 00000100:00100000:1.0:1789117576.337461:0:16226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789117576.337470:0:16226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0257c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14842:x1876025385520640:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789117576.337518:0:16226:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1789117576.340571:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117576.340831:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789117576.347897:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1789117576.350087:0:16226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0257c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14842:x1876025385520640:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12604us (12794us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789117576.350106:0:16226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789117576.350619:0:14842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02561c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14842:1876025385520640:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789117576.350637:0:14842:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:02000400:1.0:1789117576.750789:0:16580:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg637-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789117576.841121:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789117577.287295:0:14852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789117577.862584:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117578.880520:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117578.880650:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362457472 00000100:00100000:0.0:1789117578.880659:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362457472 00000100:00100000:0.0:1789117578.880700:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 74 00000100:00100000:0.0:1789117578.880708:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b9310850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2348:x1876025362457472:12345-192.168.206.37@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789117578.880733:0:14809:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from edde4d4f-1af6-41f8-b360-b9a2dcbe220a@192.168.206.37@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:0.0:1789117578.880762:0:14809:0:(genops.c:1385:class_connect()) connect: client edde4d4f-1af6-41f8-b360-b9a2dcbe220a, cookie 0xf7565228e460f014 00000100:00080000:0.0:1789117578.880890:0:14809:0:(import.c:65:import_set_state_nolock()) ffff9c1681d8d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789117578.880975:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b9310850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+5:2348:x1876025362457472:12345-192.168.206.37@tcp:250:mount.lustre.0 Request processed in 266us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117578.880984:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 74 00000100:00100000:2.0:1789117578.883101:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117578.883147:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362457600 00000100:00100000:3.0:1789117578.883155:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362457600 00000100:00100000:3.0:1789117578.883200:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 75 00000100:00100000:3.0:1789117578.883210:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b9312850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+5:13961:x1876025362457600:12345-192.168.206.37@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789117578.883236:0:14810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117578.883250:0:14810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c16829c6000/0xf7565228e460f01b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cb57 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117578.883274:0:14810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c16829c6000/0xf7565228e460f01b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb57 expref: 6 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117578.883284:0:14810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c16829c6000/0xf7565228e460f01b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb57 expref: 6 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117578.883293:0:14810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c16829c6000, rc 0) 00000100:00100000:3.0:1789117578.883338:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b9312850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+6:13961:x1876025362457600:12345-192.168.206.37@tcp:101:mount.lustre.0 Request processed in 130us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117578.883345:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 75 00000100:00100000:3.0:1789117578.884909:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117578.885005:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362457728 00000100:00100000:0.0:1789117578.885012:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362457728 00000100:00100000:0.0:1789117578.885057:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 76 00000100:00100000:0.0:1789117578.885066:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c2068850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+6:13961:x1876025362457728:12345-192.168.206.37@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789117578.885294:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c2068850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+6:13961:x1876025362457728:12345-192.168.206.37@tcp:501:mount.lustre.0 Request processed in 228us (391us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789117578.885302:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 76 00010000:00010000:1.0:1789117578.886772:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117578.894550:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117578.894856:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362457856 00000100:00100000:1.0:1789117578.894866:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362457856 00000100:00100000:1.0:1789117578.894925:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 77 00000100:00100000:1.0:1789117578.894935:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c206a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+6:13961:x1876025362457856:12345-192.168.206.37@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789117578.894951:0:14812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117578.894967:0:14812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178442ec00/0xf7565228e460f022 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cb5e expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117578.894995:0:14812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178442ec00/0xf7565228e460f022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb5e expref: 7 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117578.895005:0:14812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178442ec00/0xf7565228e460f022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb5e expref: 7 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117578.895026:0:14812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442ec00, rc 0) 00000100:00100000:1.0:1789117578.895084:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c206a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+7:13961:x1876025362457856:12345-192.168.206.37@tcp:101:mount.lustre.0 Request processed in 149us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117578.895091:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 77 00000100:00100000:2.0:1789117578.898220:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117578.898338:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362457984 00000100:00100000:3.0:1789117578.898347:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362457984 00000100:00100000:3.0:1789117578.898395:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 78 00000100:00100000:3.0:1789117578.898529:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c206b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+7:13961:x1876025362457984:12345-192.168.206.37@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789117578.899197:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c206b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+8:13961:x1876025362457984:12345-192.168.206.37@tcp:501:mount.lustre.0 Request processed in 771us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117578.899206:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 78 00000100:00100000:3.0:1789117578.907264:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117578.907367:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362458112 00000100:00100000:0.0:1789117578.907376:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362458112 00000100:00100000:0.0:1789117578.907464:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 79 00000100:00100000:0.0:1789117578.907474:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c206b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+8:13961:x1876025362458112:12345-192.168.206.37@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789117578.908043:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c206b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+8:13961:x1876025362458112:12345-192.168.206.37@tcp:503:mount.lustre.0 Request processed in 567us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117578.908052:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 79 00000100:00100000:3.0:1789117578.914026:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117578.914174:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362458240 00000100:00100000:1.0:1789117578.914184:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362458240 00000100:00100000:1.0:1789117578.914239:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 80 00000100:00100000:1.0:1789117578.914250:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c206b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+8:13979:x1876025362458240:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789117578.914558:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c206b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+8:13979:x1876025362458240:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 309us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117578.914567:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 80 00000100:00100000:1.0:1789117578.937500:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117578.937628:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362458368 00000100:00100000:3.0:1789117578.937638:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362458368 00000100:00100000:3.0:1789117578.937694:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 81 00000100:00100000:3.0:1789117578.937718:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+8:13979:x1876025362458368:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789117578.938214:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+8:13979:x1876025362458368:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 497us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117578.938224:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 81 00000100:00100000:2.0:1789117578.942189:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117578.942497:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362458496 00000100:00100000:0.0:1789117578.942507:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362458496 00000100:00100000:0.0:1789117578.942607:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 82 00000100:00100000:0.0:1789117578.942618:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0249c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+8:13961:x1876025362458496:12345-192.168.206.37@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789117578.942633:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117578.942651:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1787cbd400/0xf7565228e460f029 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cb88 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117578.942683:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1787cbd400/0xf7565228e460f029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb88 expref: 9 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117578.942694:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1787cbd400/0xf7565228e460f029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb88 expref: 9 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117578.942704:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbd400, rc 0) 00000100:00100000:0.0:1789117578.942955:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0249c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+9:13961:x1876025362458496:12345-192.168.206.37@tcp:101:mount.lustre.0 Request processed in 143us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117578.942962:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 82 00000100:00100000:0.0:1789117578.945722:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117578.945903:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362458624 00000100:00100000:3.0:1789117578.945911:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362458624 00000100:00100000:3.0:1789117578.945962:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 83 00000100:00100000:3.0:1789117578.945972:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0248050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+9:13961:x1876025362458624:12345-192.168.206.37@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789117578.945994:0:14812:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789117578.946016:0:14812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789117578.946021:0:14812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789117578.946161:0:14812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789117578.946166:0:14812:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1789117578.948896:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0248050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+9:13961:x1876025362458624:12345-192.168.206.37@tcp:256:mount.lustre.0 Request processed in 2917us (3179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117578.948909:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 83 00000100:00100000:2.0:1789117578.952551:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117578.952644:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362458752 00000100:00100000:0.0:1789117578.952653:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362458752 00000100:00100000:0.0:1789117578.952749:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 84 00000100:00100000:0.0:1789117578.952761:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0248450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+9:13961:x1876025362458752:12345-192.168.206.37@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789117578.952778:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117578.952810:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1787cbca00/0xf7565228e460f030 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cb8f expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117578.952836:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1787cbca00/0xf7565228e460f030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb8f expref: 10 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117578.952848:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1787cbca00/0xf7565228e460f030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb8f expref: 10 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117578.952862:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbca00, rc 0) 00000100:00100000:0.0:1789117578.952951:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0248450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+10:13961:x1876025362458752:12345-192.168.206.37@tcp:101:mount.lustre.0 Request processed in 193us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117578.952958:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 84 00000100:00100000:1.0:1789117578.956261:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117578.956367:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362458880 00000100:00100000:3.0:1789117578.956377:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362458880 00000100:00100000:1.0:1789117578.956837:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 85 00000100:00100000:1.0:1789117578.956849:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c024bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+10:13961:x1876025362458880:12345-192.168.206.37@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789117578.957591:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c024bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+10:13961:x1876025362458880:12345-192.168.206.37@tcp:501:mount.lustre.0 Request processed in 742us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117578.957600:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 85 00000100:00100000:3.0:1789117578.964125:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117578.964333:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362459008 00000100:00100000:0.0:1789117578.964352:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362459008 00000100:00100000:0.0:1789117578.964530:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 86 00000100:00100000:0.0:1789117578.964540:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+10:13961:x1876025362459008:12345-192.168.206.37@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789117578.964794:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+10:13961:x1876025362459008:12345-192.168.206.37@tcp:503:mount.lustre.0 Request processed in 254us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117578.964803:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 86 00000100:00100000:2.0:1789117578.968950:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117578.969154:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362459136 00000100:00100000:1.0:1789117578.969165:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362459136 00000100:00100000:1.0:1789117578.969222:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 87 00000100:00100000:1.0:1789117578.969233:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c024ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+10:13983:x1876025362459136:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789117578.969576:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c024ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+10:13983:x1876025362459136:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 344us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117578.969590:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 87 00000100:00100000:1.0:1789117578.975210:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117578.977700:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362459264 00000100:00100000:0.0:1789117578.977712:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362459264 00000100:00100000:0.0:1789117578.977902:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 88 00000100:00100000:0.0:1789117578.977913:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0248c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+10:13983:x1876025362459264:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789117578.978921:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0248c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+10:13983:x1876025362459264:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 1005us (3717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117578.978931:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 88 00000100:00100000:3.0:1789117578.982838:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117578.983157:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362459392 00000100:00100000:0.0:1789117578.983166:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362459392 00000100:00100000:0.0:1789117578.983208:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 4 00000100:00100000:0.0:1789117578.983216:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2348:x1876025362459392:12345-192.168.206.37@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789117578.983246:0:14819:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 07947d2f-ef96-4aa5-be78-0cb12cc06f21@192.168.206.37@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:0.0:1789117578.983294:0:14819:0:(genops.c:1385:class_connect()) connect: client 07947d2f-ef96-4aa5-be78-0cb12cc06f21, cookie 0xf7565228e460f037 00000004:00100000:0.0:1789117578.983321:0:14819:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1789117578.983327:0:14819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1789117578.991184:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117578.991693:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362459776 00000100:00100000:1.0:1789117578.991702:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362459776 00000100:00100000:1.0:1789117578.991757:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 89 00000100:00100000:1.0:1789117578.991767:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0249050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+10:2352:x1876025362459776:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117578.991842:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0249050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+10:2352:x1876025362459776:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 75us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117578.991849:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 89 00000100:00080000:0.0:1789117579.053114:0:14819:0:(import.c:65:import_set_state_nolock()) ffff9c1681d8f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789117579.053193:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+6:2348:x1876025362459392:12345-192.168.206.37@tcp:38:mount.lustre.0 Request processed in 69975us (70363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117579.053204:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 4 00000100:00100000:1.0:1789117579.069219:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117579.069305:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117579.069385:0:15529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362459520 00000100:00100000:0.0:1789117579.069395:0:15529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362459520 00000100:00080000:1.0:1789117579.069481:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117579.069497:0:15529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362459648 00000100:00100000:0.0:1789117579.069502:0:15529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362459648 00000100:00100000:0.0:1789117579.069656:0:15529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 5 00000100:00100000:0.0:1789117579.069667:0:15529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+7:0:x1876025362459520:12345-192.168.206.37@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789117579.069705:0:15529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789117579.069788:0:15529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+7:0:x1876025362459520:12345-192.168.206.37@tcp:41:mount.lustre.0 Request processed in 122us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117579.069796:0:15529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 5 00000100:00100000:0.0:1789117579.069813:0:15529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 6 00000100:00100000:0.0:1789117579.069820:0:15529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+6:13961:x1876025362459648:12345-192.168.206.37@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789117579.069832:0:15529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789117579.069864:0:15529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+6:13961:x1876025362459648:12345-192.168.206.37@tcp:41:mount.lustre.0 Request processed in 44us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117579.069885:0:15529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 6 00000100:00100000:3.0:1789117579.075009:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117579.076809:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362459904 00000100:00100000:1.0:1789117579.076827:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362459904 00000100:00100000:1.0:1789117579.076900:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 7 00000100:00100000:1.0:1789117579.076912:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+6:13961:x1876025362459904:12345-192.168.206.37@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789117579.077010:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+6:13961:x1876025362459904:12345-192.168.206.37@tcp:40:mount.lustre.0 Request processed in 100us (2009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117579.077017:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 7 00000100:00100000:3.0:1789117579.079303:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117579.079354:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117579.079482:0:15503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362460032 00000100:00100000:0.0:1789117579.079491:0:15503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362460032 00000100:00100000:0.0:1789117579.079533:0:15503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362460160 00000100:00100000:0.0:1789117579.079537:0:15503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362460160 00000100:00100000:0.0:1789117579.079561:0:15503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 8 00000100:00100000:0.0:1789117579.079569:0:15503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1876025362460032:12345-192.168.206.37@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789117579.079600:0:15503:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 07947d2f-ef96-4aa5-be78-0cb12cc06f21@192.168.206.37@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:0.0:1789117579.079628:0:15503:0:(genops.c:1385:class_connect()) connect: client 07947d2f-ef96-4aa5-be78-0cb12cc06f21, cookie 0xf7565228e460f03e 00002000:00100000:0.0:1789117579.079639:0:15503:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 07947d2f-ef96-4aa5-be78-0cb12cc06f21/ffff9c1681d88000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789117579.079660:0:15503:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789117579.080060:0:15503:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789117579.080091:0:15503:0:(import.c:65:import_set_state_nolock()) ffff9c1681d8b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789117579.080152:0:15503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+6:2348:x1876025362460032:12345-192.168.206.37@tcp:8:mount.lustre.0 Request processed in 582us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117579.080161:0:15503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 8 00000100:00100000:0.0:1789117579.080179:0:15503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 9 00000100:00100000:0.0:1789117579.080183:0:15503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1876025362460160:12345-192.168.206.37@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789117579.080198:0:15503:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 07947d2f-ef96-4aa5-be78-0cb12cc06f21@192.168.206.37@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:0.0:1789117579.080217:0:15503:0:(genops.c:1385:class_connect()) connect: client 07947d2f-ef96-4aa5-be78-0cb12cc06f21, cookie 0xf7565228e460f045 00002000:00100000:0.0:1789117579.080222:0:15503:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 07947d2f-ef96-4aa5-be78-0cb12cc06f21/ffff9c1681d88800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789117579.080235:0:15503:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789117579.080350:0:15503:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789117579.080367:0:15503:0:(import.c:65:import_set_state_nolock()) ffff9c1681d8a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789117579.080527:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117579.080966:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362460288 00000100:00100000:3.0:1789117579.080972:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362460288 00000100:00100000:3.0:1789117579.081009:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 0 00000100:00100000:3.0:1789117579.081025:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+6:13961:x1876025362460288:12345-192.168.206.37@tcp:33:mount.lustre.0 00000100:00100000:0.0:1789117579.082083:0:15503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+6:2348:x1876025362460160:12345-192.168.206.37@tcp:8:mount.lustre.0 Request processed in 1893us (2724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117579.082094:0:15503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 9 00000004:00080000:0.0:1789117579.083556:0:14821:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2476us 00000004:00200000:0.0:1789117579.101453:0:14821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1789117579.101711:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+6:13961:x1876025362460288:12345-192.168.206.37@tcp:33:mount.lustre.0 Request processed in 20681us (21177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117579.101727:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 0 00000100:00100000:3.0:1789117579.242121:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117579.242243:0:15529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362460416 00000100:00100000:0.0:1789117579.242253:0:15529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362460416 00000100:00100000:0.0:1789117579.242311:0:15529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 8 00000100:00100000:0.0:1789117579.242321:0:15529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c179198c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+6:14005:x1876025362460416:12345-192.168.206.37@tcp:101:mkdir.0 00010000:00010000:0.0:1789117579.242340:0:15529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117579.242365:0:15529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f04c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cbb9 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117579.242476:0:15529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f053 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117579.242490:0:15529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f053 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117579.242503:0:15529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f053 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117579.242690:0:15529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789117579.242694:0:15529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1789117579.242809:0:15529:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f053 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117579.242845:0:15529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f04c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cbb9 expref: 8 pid: 15529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117579.242861:0:15529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f053 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cbb9 expref: 7 pid: 15529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117579.242869:0:15529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782c0ea00) 00010000:00010000:0.0:1789117579.242872:0:15529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789117579.242875:0:15529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbda00, rc 0) 00000100:00100000:0.0:1789117579.242933:0:15529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c179198c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+7:14005:x1876025362460416:12345-192.168.206.37@tcp:101:mkdir.0 Request processed in 614us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117579.242940:0:15529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 8 00000001:00100000:2.0:1789117579.386395:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 07947d2f-ef96-4aa5-be78-0cb12cc06f21 00010000:00010000:1.0:1789117579.909690:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117580.934443:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117581.156121:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117581.156223:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362460544 00000100:00100000:1.0:1789117581.156241:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362460544 00000100:00100000:1.0:1789117581.156307:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 9 00000100:00100000:1.0:1789117581.156318:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+7:14058:x1876025362460544:12345-192.168.206.37@tcp:41:lfs.0 00000004:00000024:1.0:1789117581.156361:0:14819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789117581.156501:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+7:14058:x1876025362460544:12345-192.168.206.37@tcp:41:lfs.0 Request processed in 184us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117581.156509:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 9 00000100:00080000:2.0:1789117581.156661:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117581.160818:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117581.160931:0:15505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362460672 00000100:00100000:0.0:1789117581.160941:0:15505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362460672 00000100:00100000:0.0:1789117581.161022:0:15505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 3 00000100:00100000:0.0:1789117581.161033:0:15505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07947d2f-ef96-4aa5-be78-0cb12cc06f21+5:14058:x1876025362460672:12345-192.168.206.37@tcp:13:lfs.0 00002000:00000024:0.0:1789117581.161071:0:15505:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789117581.161153:0:15505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07947d2f-ef96-4aa5-be78-0cb12cc06f21+5:14058:x1876025362460672:12345-192.168.206.37@tcp:13:lfs.0 Request processed in 122us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117581.161161:0:15505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 3 00000100:00080000:2.0:1789117581.161449:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117581.163039:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117581.163129:0:15505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362460800 00000100:00100000:2.0:1789117581.163138:0:15505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362460800 00000100:00100000:2.0:1789117581.163206:0:15505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 4 00000100:00100000:2.0:1789117581.163218:0:15505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0256940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07947d2f-ef96-4aa5-be78-0cb12cc06f21+6:14058:x1876025362460800:12345-192.168.206.37@tcp:13:lfs.0 00002000:00000024:2.0:1789117581.163255:0:15505:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789117581.163337:0:15505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0256940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07947d2f-ef96-4aa5-be78-0cb12cc06f21+6:14058:x1876025362460800:12345-192.168.206.37@tcp:13:lfs.0 Request processed in 122us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117581.163345:0:15505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 4 00000100:00080000:1.0:1789117581.163570:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789117581.337265:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117581.340284:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362460928 00000100:00100000:1.0:1789117581.340298:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362460928 00000100:00100000:1.0:1789117581.340372:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 90 00000100:00100000:1.0:1789117581.340384:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c024b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+10:14089:x1876025362460928:12345-192.168.206.37@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789117581.340437:0:14810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117581.340457:0:14810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178442f200/0xf7565228e460f05a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cbc0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117581.340487:0:14810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178442f200/0xf7565228e460f05a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cbc0 expref: 11 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117581.340499:0:14810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178442f200/0xf7565228e460f05a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cbc0 expref: 11 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117581.340509:0:14810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442f200, rc 0) 00000100:00100000:1.0:1789117581.340588:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c024b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+11:14089:x1876025362460928:12345-192.168.206.37@tcp:101:mount.lustre.0 Request processed in 206us (3331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117581.340596:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 90 00000100:00100000:3.0:1789117581.352493:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117581.352587:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362461056 00000100:00100000:0.0:1789117581.352598:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362461056 00000100:00100000:0.0:1789117581.352650:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 91 00000100:00100000:0.0:1789117581.352660:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c024b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+11:14089:x1876025362461056:12345-192.168.206.37@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789117581.352964:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c024b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+11:14089:x1876025362461056:12345-192.168.206.37@tcp:501:mount.lustre.0 Request processed in 305us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117581.352974:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 91 00000100:00100000:0.0:1789117581.356229:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117581.356330:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362461184 00000100:00100000:2.0:1789117581.356339:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362461184 00000100:00100000:2.0:1789117581.356445:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 92 00000100:00100000:2.0:1789117581.356455:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c024a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+11:14089:x1876025362461184:12345-192.168.206.37@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789117581.356673:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c024a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+11:14089:x1876025362461184:12345-192.168.206.37@tcp:503:mount.lustre.0 Request processed in 219us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117581.356682:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 92 00000100:00100000:2.0:1789117581.360441:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117581.360598:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362461312 00000100:00100000:0.0:1789117581.360608:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362461312 00000100:00100000:0.0:1789117581.360664:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 93 00000100:00100000:0.0:1789117581.360674:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c024a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+11:14096:x1876025362461312:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789117581.360957:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c024a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+11:14096:x1876025362461312:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 283us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117581.360965:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 93 00000100:00100000:1.0:1789117581.382172:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385520896:0@lo:400:kworker.0 00000100:00100000:2.0:1789117581.382188:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385521152:0@lo:400:kworker.0 00000100:00100000:3.0:1789117581.382267:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3298:1876025385520768:0@lo:400:kworker.0 00000100:00100000:0.0:1789117581.382821:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385521024:0@lo:400:kworker.0 00000100:00100000:2.0:1789117581.386586:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117581.386692:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385521664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117581.387690:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117581.387846:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117581.387885:0:15501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385520896 00000100:00100000:1.0:1789117581.387893:0:15501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385520896 00000100:00100000:1.0:1789117581.387948:0:15501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789117581.387957:0:15501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385520896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117581.388021:0:15501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876025385520896:12345-0@lo:400:kworker.0 Request processed in 65us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117581.388028:0:15501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789117581.388048:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789117581.388081:0:15529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385521152 00000100:00100000:1.0:1789117581.388085:0:15529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385521152 00000100:00100000:1.0:1789117581.388109:0:15529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789117581.388116:0:15529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385521152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117581.395579:0:15529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385521152:12345-0@lo:400:kworker.0 Request processed in 7439us (8976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117581.395594:0:15529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789117581.399649:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117581.399704:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385521536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117581.399756:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117581.399801:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385521664 00000100:00100000:1.0:1789117581.399810:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385521664 00000100:00100000:1.0:1789117581.399843:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385521536 00000100:00100000:1.0:1789117581.399846:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385521536 00000100:00100000:1.0:1789117581.399873:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789117581.399882:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385521664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117581.399905:0:15506:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117581.399945:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385521664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (12258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117581.399953:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789117581.399969:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789117581.399975:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1876025385521536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117581.399986:0:15506:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117581.400028:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1876025385521536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117581.400034:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789117581.400051:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789117581.400086:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385521536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789117581.400143:0:15503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385521024 00000100:00100000:1.0:1789117581.400147:0:15503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385521024 00000100:00100000:1.0:1789117581.400171:0:15503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789117581.400178:0:15503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3300:x1876025385521024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117581.400214:0:15503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3300:x1876025385521024:12345-0@lo:400:kworker.0 Request processed in 36us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117581.400220:0:15503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789117581.400245:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385521024:0@lo:400:kworker.0 00000100:00100000:1.0:1789117581.400301:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385521664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117581.400316:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385521152:0@lo:400:kworker.0 00000100:00100000:1.0:1789117581.400380:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117581.400439:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362461440 00000100:00100000:1.0:1789117581.400443:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362461440 00000100:00100000:1.0:1789117581.400468:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 94 00000100:00100000:1.0:1789117581.400475:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c024a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+11:14096:x1876025362461440:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789117581.400796:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c024a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+11:14096:x1876025362461440:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 320us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117581.400804:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 94 00000100:00100000:3.0:1789117581.403259:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117581.403453:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681ef03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385521280:0@lo:400:kworker.0 00000100:00100000:3.0:1789117581.403514:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117581.403545:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385521280 00000100:00100000:3.0:1789117581.403553:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385521280 00000100:00100000:3.0:1789117581.403608:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789117581.403618:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385521280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117581.403668:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385521280:12345-0@lo:400:kworker.0 Request processed in 51us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117581.403675:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1789117581.403697:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117581.403725:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681ef03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385521280:0@lo:400:kworker.0 00000100:00100000:3.0:1789117581.403743:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117581.403749:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681ef0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385521408:0@lo:400:kworker.0 00000100:00100000:3.0:1789117581.403787:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117581.403820:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385521408 00000100:00100000:3.0:1789117581.403824:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385521408 00000100:00100000:3.0:1789117581.403851:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789117581.403857:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385521408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117581.403888:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385521408:12345-0@lo:400:kworker.0 Request processed in 32us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117581.403906:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789117581.403920:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117581.403937:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681ef0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385521408:0@lo:400:kworker.0 00000100:00100000:3.0:1789117581.403968:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385520768 00000100:00100000:3.0:1789117581.403972:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385520768 00000100:00100000:3.0:1789117581.403995:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789117581.404001:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c024b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:3298:x1876025385520768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117581.404036:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c024b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:3298:x1876025385520768:12345-0@lo:400:kworker.0 Request processed in 35us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117581.404042:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789117581.404076:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3298:1876025385520768:0@lo:400:kworker.0 00000100:00100000:3.0:1789117581.411604:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117581.411778:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876025385520896:0@lo:400:kworker.0 00000100:00100000:2.0:1789117581.411836:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362461568 00000100:00100000:2.0:1789117581.411842:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362461568 00000100:00100000:2.0:1789117581.411884:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 96 00000100:00100000:2.0:1789117581.411893:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0249450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+11:14089:x1876025362461568:12345-192.168.206.37@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789117581.411908:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117581.411925:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178457f200/0xf7565228e460f061 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cbea expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117581.411953:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178457f200/0xf7565228e460f061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cbea expref: 12 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117581.411963:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178457f200/0xf7565228e460f061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cbea expref: 12 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117581.411972:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f200, rc 0) 00000100:00100000:2.0:1789117581.412021:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0249450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+12:14089:x1876025362461568:12345-192.168.206.37@tcp:101:mount.lustre.0 Request processed in 128us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117581.412028:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 96 00000100:00100000:3.0:1789117581.424072:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117581.424100:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362461696 00000100:00100000:3.0:1789117581.424109:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362461696 00000100:00100000:3.0:1789117581.424148:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 97 00000100:00100000:3.0:1789117581.424156:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+12:14089:x1876025362461696:12345-192.168.206.37@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789117581.424178:0:14810:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789117581.424195:0:14810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789117581.424199:0:14810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789117581.424201:0:14810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789117581.424204:0:14810:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1789117581.429756:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+12:14089:x1876025362461696:12345-192.168.206.37@tcp:256:mount.lustre.0 Request processed in 5590us (5683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117581.429770:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 97 00000100:00100000:0.0:1789117581.438738:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117581.438774:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362461824 00000100:00100000:0.0:1789117581.438784:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362461824 00000100:00100000:0.0:1789117581.438832:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 98 00000100:00100000:0.0:1789117581.438842:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+12:14089:x1876025362461824:12345-192.168.206.37@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789117581.438858:0:14812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117581.438875:0:14812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1787cbd200/0xf7565228e460f068 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cbf1 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117581.438915:0:14812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1787cbd200/0xf7565228e460f068 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cbf1 expref: 13 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117581.438927:0:14812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1787cbd200/0xf7565228e460f068 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cbf1 expref: 13 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117581.438951:0:14812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbd200, rc 0) 00000100:00100000:0.0:1789117581.438999:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:14089:x1876025362461824:12345-192.168.206.37@tcp:101:mount.lustre.0 Request processed in 158us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117581.439005:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 98 00000100:00100000:3.0:1789117581.441232:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117581.441559:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362461952 00000100:00100000:2.0:1789117581.441570:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362461952 00000100:00100000:2.0:1789117581.441629:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 99 00000100:00100000:2.0:1789117581.441639:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:14089:x1876025362461952:12345-192.168.206.37@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789117581.441925:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:14089:x1876025362461952:12345-192.168.206.37@tcp:501:mount.lustre.0 Request processed in 286us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117581.441943:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 99 00000100:00100000:0.0:1789117581.448392:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117581.450312:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362462080 00000100:00100000:2.0:1789117581.450325:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362462080 00000100:00100000:1.0:1789117581.450464:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 100 00000100:00100000:1.0:1789117581.450475:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:14089:x1876025362462080:12345-192.168.206.37@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789117581.450665:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:14089:x1876025362462080:12345-192.168.206.37@tcp:503:mount.lustre.0 Request processed in 191us (2280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117581.450674:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 100 00000100:00100000:3.0:1789117581.455484:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117581.455527:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362462208 00000100:00100000:3.0:1789117581.455535:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362462208 00000100:00100000:3.0:1789117581.455580:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 101 00000100:00100000:3.0:1789117581.455590:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:14100:x1876025362462208:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789117581.455845:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:14100:x1876025362462208:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 255us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117581.455854:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 101 00000100:00100000:2.0:1789117581.462375:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117581.467044:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362462336 00000100:00100000:3.0:1789117581.467058:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362462336 00000100:00100000:3.0:1789117581.467145:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 102 00000100:00100000:3.0:1789117581.467155:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:14100:x1876025362462336:12345-192.168.206.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789117581.467389:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:14100:x1876025362462336:12345-192.168.206.37@tcp:502:llog_process_th.0 Request processed in 235us (5033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117581.467443:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 102 00000100:00100000:3.0:1789117581.472993:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117581.474607:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362462464 00000100:00100000:0.0:1789117581.474619:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362462464 00000100:00100000:0.0:1789117581.474675:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 10 00000100:00100000:0.0:1789117581.474683:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2348:x1876025362462464:12345-192.168.206.37@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789117581.474711:0:14819:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 28194745-e310-497c-8221-affa7d89f6fa@192.168.206.37@tcp t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:0.0:1789117581.474757:0:14819:0:(genops.c:1385:class_connect()) connect: client 28194745-e310-497c-8221-affa7d89f6fa, cookie 0xf7565228e460f06f 00000004:00100000:0.0:1789117581.474788:0:14819:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789117581.474919:0:14819:0:(import.c:65:import_set_state_nolock()) ffff9c17a4a57800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789117581.474993:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28194745-e310-497c-8221-affa7d89f6fa+6:2348:x1876025362462464:12345-192.168.206.37@tcp:38:mount.lustre.0 Request processed in 309us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117581.475001:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 10 00000100:00100000:3.0:1789117581.483296:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117581.487037:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362462720 00000100:00100000:0.0:1789117581.487051:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362462720 00000100:00100000:0.0:1789117581.487181:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 11 00000100:00100000:0.0:1789117581.487193:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28194745-e310-497c-8221-affa7d89f6fa+6:14089:x1876025362462720:12345-192.168.206.37@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789117581.487225:0:14818:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789117581.487309:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28194745-e310-497c-8221-affa7d89f6fa+6:14089:x1876025362462720:12345-192.168.206.37@tcp:41:mount.lustre.0 Request processed in 118us (4023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117581.487316:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 11 00000100:00080000:3.0:1789117581.487510:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117581.503023:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117581.503155:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117581.503290:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362462592 00000100:00100000:3.0:1789117581.503299:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362462592 00000100:00100000:3.0:1789117581.503352:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362462848 00000100:00100000:3.0:1789117581.503356:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362462848 00000100:00100000:3.0:1789117581.503385:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 12 00000100:00100000:3.0:1789117581.503396:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0255e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28194745-e310-497c-8221-affa7d89f6fa+7:0:x1876025362462592:12345-192.168.206.37@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789117581.503589:0:14819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789117581.503703:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0255e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28194745-e310-497c-8221-affa7d89f6fa+7:0:x1876025362462592:12345-192.168.206.37@tcp:41:mount.lustre.0 Request processed in 308us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117581.503719:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 12 00000100:00100000:3.0:1789117581.503736:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 13 00000100:00100000:3.0:1789117581.503743:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0254780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28194745-e310-497c-8221-affa7d89f6fa+6:14089:x1876025362462848:12345-192.168.206.37@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789117581.503961:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0254780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28194745-e310-497c-8221-affa7d89f6fa+6:14089:x1876025362462848:12345-192.168.206.37@tcp:40:mount.lustre.0 Request processed in 217us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117581.503968:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 13 00000100:00100000:0.0:1789117581.508300:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117581.508485:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117581.508619:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117581.508667:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362463232 00000100:00100000:3.0:1789117581.508675:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362463232 00000100:00100000:3.0:1789117581.508714:0:14820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 1 00000100:00100000:3.0:1789117581.508731:0:14820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0256d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28194745-e310-497c-8221-affa7d89f6fa+6:14089:x1876025362463232:12345-192.168.206.37@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789117581.508968:0:14820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1789117581.509104:0:14820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0256d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28194745-e310-497c-8221-affa7d89f6fa+6:14089:x1876025362463232:12345-192.168.206.37@tcp:33:mount.lustre.0 Request processed in 380us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117581.509112:0:14820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 1 00000100:00100000:1.0:1789117581.518020:0:15501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362462976 00000100:00100000:1.0:1789117581.518037:0:15501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362462976 00000100:00100000:1.0:1789117581.518085:0:15501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362463104 00000100:00100000:1.0:1789117581.518089:0:15501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362463104 00000100:00100000:1.0:1789117581.518121:0:15501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 10 00000100:00100000:1.0:1789117581.518129:0:15501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0254f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1876025362462976:12345-192.168.206.37@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789117581.518164:0:15501:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 28194745-e310-497c-8221-affa7d89f6fa@192.168.206.37@tcp t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:1.0:1789117581.518193:0:15501:0:(genops.c:1385:class_connect()) connect: client 28194745-e310-497c-8221-affa7d89f6fa, cookie 0xf7565228e460f076 00002000:00100000:1.0:1789117581.518205:0:15501:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 28194745-e310-497c-8221-affa7d89f6fa/ffff9c17bb971000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789117581.518216:0:15501:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789117581.518334:0:16226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 11 00000100:00100000:3.0:1789117581.518343:0:16226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1876025362463104:12345-192.168.206.37@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789117581.518364:0:16226:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 28194745-e310-497c-8221-affa7d89f6fa@192.168.206.37@tcp t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:3.0:1789117581.518440:0:16226:0:(genops.c:1385:class_connect()) connect: client 28194745-e310-497c-8221-affa7d89f6fa, cookie 0xf7565228e460f07d 00002000:00100000:3.0:1789117581.518449:0:16226:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 28194745-e310-497c-8221-affa7d89f6fa/ffff9c179816c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789117581.518458:0:16226:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789117581.518494:0:15501:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789117581.518528:0:15501:0:(import.c:65:import_set_state_nolock()) ffff9c17bb972800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789117581.518598:0:15501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0254f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28194745-e310-497c-8221-affa7d89f6fa+6:2348:x1876025362462976:12345-192.168.206.37@tcp:8:mount.lustre.0 Request processed in 468us (10112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117581.518607:0:15501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 10 00002000:00080000:3.0:1789117581.519175:0:16226:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789117581.519196:0:16226:0:(import.c:65:import_set_state_nolock()) ffff9c179816c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789117581.519244:0:16226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28194745-e310-497c-8221-affa7d89f6fa+6:2348:x1876025362463104:12345-192.168.206.37@tcp:8:mount.lustre.0 Request processed in 899us (10624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117581.519260:0:16226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 11 00000001:00100000:1.0:1789117581.565760:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 07947d2f-ef96-4aa5-be78-0cb12cc06f21 00000001:00080000:1.0:1789117581.565781:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1789117581.565790:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789117581.658274:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117581.658446:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362463360 00000100:00100000:3.0:1789117581.658455:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362463360 00000100:00100000:3.0:1789117581.658521:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 14 00000100:00100000:3.0:1789117581.658533:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28194745-e310-497c-8221-affa7d89f6fa+6:14122:x1876025362463360:12345-192.168.206.37@tcp:101:mkdir.0 00010000:00010000:3.0:1789117581.658556:0:14819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117581.658579:0:14819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f084 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cc1b expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117581.658642:0:14819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f08b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117581.658656:0:14819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f08b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117581.658669:0:14819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f08b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117581.658868:0:14819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789117581.658873:0:14819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1789117581.658960:0:14819:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f08b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117581.658989:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f084 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc1b expref: 8 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117581.659006:0:14819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f08b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc1b expref: 7 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117581.659027:0:14819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782c0ea00) 00010000:00010000:3.0:1789117581.659030:0:14819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789117581.659034:0:14819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c16829c7c00, rc 0) 00000100:00100000:3.0:1789117581.659111:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28194745-e310-497c-8221-affa7d89f6fa+7:14122:x1876025362463360:12345-192.168.206.37@tcp:101:mkdir.0 Request processed in 580us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117581.659119:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 14 00010000:00010000:1.0:1789117581.957894:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117582.985380:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117584.007042:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789117584.528208:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 28194745-e310-497c-8221-affa7d89f6fa 00000001:00100000:1.0:1789117584.528223:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 07947d2f-ef96-4aa5-be78-0cb12cc06f21 00000001:00100000:2.0:1789117584.559187:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28194745-e310-497c-8221-affa7d89f6fa 00000001:02000400:0.0:1789117584.601808:0:16783:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789117585.029806:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117586.056955:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117586.503266:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385521792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117586.503349:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117586.503444:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117586.503452:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385521920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117586.503476:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117586.503520:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385521792 00000100:00100000:3.0:1789117586.503527:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385521792 00000100:00100000:3.0:1789117586.503568:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385521920 00000100:00100000:3.0:1789117586.503570:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385521920 00000100:00100000:3.0:1789117586.503584:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789117586.503593:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385521792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117586.503624:0:15506:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117586.503665:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385521792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117586.503672:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789117586.503690:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789117586.503696:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385521920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117586.503733:0:15506:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117586.503764:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385521920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117586.503770:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789117586.503791:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789117586.503794:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117586.503822:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385521920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117586.503832:0:3298:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789117586.503850:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385521792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789117586.504120:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385522176:0@lo:400:kworker.0 00000100:00100000:0.0:1789117586.504150:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117586.504172:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789117586.504177:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3301:1876025385522048:0@lo:400:kworker.0 00000100:00100000:2.0:1789117586.504523:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0255680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385522304:0@lo:400:kworker.0 00000100:00100000:2.0:1789117586.504555:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117586.504576:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117586.504581:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0255a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385522432:0@lo:400:kworker.0 00000100:00100000:2.0:1789117586.504601:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117586.504644:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385522176 00000100:00100000:2.0:1789117586.504649:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385522176 00000100:00100000:2.0:1789117586.504686:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385522304 00000100:00100000:2.0:1789117586.504689:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385522304 00000100:00100000:2.0:1789117586.504710:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385522432 00000100:00100000:2.0:1789117586.504712:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385522432 00000100:00100000:2.0:1789117586.504726:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789117586.504732:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385522176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117586.504771:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876025385522176:12345-0@lo:400:kworker.0 Request processed in 38us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117586.504777:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789117586.504792:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789117586.504798:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385522304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117586.504829:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385522304:12345-0@lo:400:kworker.0 Request processed in 32us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117586.504835:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789117586.504857:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789117586.504863:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385522432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117586.504891:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876025385522432:12345-0@lo:400:kworker.0 Request processed in 29us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117586.504897:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789117586.504915:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117586.504934:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0255a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876025385522432:0@lo:400:kworker.0 00000100:00100000:2.0:1789117586.504944:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0255680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385522304:0@lo:400:kworker.0 00000100:00100000:0.0:1789117586.505007:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117586.505056:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876025385522176:0@lo:400:kworker.0 00000100:00100000:2.0:1789117586.507337:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385522048 00000100:00100000:2.0:1789117586.507350:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385522048 00000100:00100000:2.0:1789117586.507427:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789117586.507438:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:3301:x1876025385522048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117586.507525:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:3301:x1876025385522048:12345-0@lo:400:kworker.0 Request processed in 89us (3321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117586.507533:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789117586.507689:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3301:1876025385522048:0@lo:400:kworker.0 00000001:00100000:1.0:1789117586.566810:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28194745-e310-497c-8221-affa7d89f6fa 00000100:00100000:3.0:1789117586.594091:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117586.594137:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117586.594164:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117586.594187:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117586.594209:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362463488 00000100:00100000:3.0:1789117586.594218:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362463488 00000100:00100000:3.0:1789117586.594271:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 104 00000100:00100000:3.0:1789117586.594281:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:2352:x1876025362463488:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117586.594350:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:2352:x1876025362463488:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 70us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117586.594357:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 104 00000100:00100000:1.0:1789117586.594757:0:15501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362463872 00000100:00100000:1.0:1789117586.594763:0:15501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362463872 00000100:00100000:1.0:1789117586.594813:0:15501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362464128 00000100:00100000:1.0:1789117586.594816:0:15501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362464128 00000100:00100000:1.0:1789117586.594839:0:15501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 2 00000100:00100000:1.0:1789117586.594846:0:15501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+5:2352:x1876025362463872:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117586.594881:0:15501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+5:2352:x1876025362463872:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 35us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117586.594888:0:15501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 2 00000100:00100000:1.0:1789117586.594900:0:15501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 3 00000100:00100000:1.0:1789117586.594906:0:15501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28194745-e310-497c-8221-affa7d89f6fa+5:2352:x1876025362464128:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117586.594930:0:15501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28194745-e310-497c-8221-affa7d89f6fa+5:2352:x1876025362464128:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 24us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117586.594935:0:15501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 3 00000100:00080000:1.0:1789117586.594953:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789117586.594956:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117586.595187:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117586.595270:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117586.595309:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117586.595419:0:15529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362463616 00000100:00100000:3.0:1789117586.595424:0:15529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362463616 00000100:00100000:3.0:1789117586.595460:0:15529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362464000 00000100:00100000:3.0:1789117586.595474:0:15529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362464000 00000100:00100000:3.0:1789117586.595559:0:15529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 19 00000100:00100000:3.0:1789117586.595569:0:15529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+6:2352:x1876025362463616:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117586.595709:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 20 00000100:00100000:0.0:1789117586.595719:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28194745-e310-497c-8221-affa7d89f6fa+6:2352:x1876025362464000:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:0.0:1789117586.595755:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28194745-e310-497c-8221-affa7d89f6fa+6:2352:x1876025362464000:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 40us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117586.595762:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 20 00000100:00100000:1.0:1789117586.595885:0:15501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362463744 00000100:00100000:1.0:1789117586.595890:0:15501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362463744 00000100:00100000:1.0:1789117586.595925:0:15501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362464256 00000100:00100000:1.0:1789117586.595928:0:15501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362464256 00000100:00100000:1.0:1789117586.595948:0:15501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 4 00000100:00100000:1.0:1789117586.595955:0:15501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c93c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+5:2352:x1876025362463744:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117586.595983:0:15501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c93c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+5:2352:x1876025362463744:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 28us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117586.595989:0:15501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 4 00000100:00100000:1.0:1789117586.596001:0:15501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 5 00000100:00100000:1.0:1789117586.596016:0:15501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c90b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28194745-e310-497c-8221-affa7d89f6fa+5:2352:x1876025362464256:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117586.596041:0:15501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c90b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28194745-e310-497c-8221-affa7d89f6fa+5:2352:x1876025362464256:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 26us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117586.596046:0:15501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 5 00000100:00080000:1.0:1789117586.596062:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117586.596065:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789117586.596068:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117586.596201:0:15529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+6:2352:x1876025362463616:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 633us (2118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117586.596209:0:15529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 19 00010000:00010000:2.0:1789117587.077630:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789117587.528287:0:14852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1789117587.984648:0:16931:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd831d2d90 20000000:00000080:2.0:1789117587.984665:0:16931:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c17b68aec00 uarg=0000000000000000 20000000:01000000:2.0:1789117587.984702:0:16931:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789117587.984708:0:16931:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789117587.984713:0:16931:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789117587.985800:0:16932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1789117587.986046:0:16931:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789117587.993244:0:16931:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789117587.993275:0:16931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c178457f000/0xf7565228e460f092 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117587.993304:0:16931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1787cbcc00/0xf7565228e460ed89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460ed82 expref: 18 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117587.993312:0:16931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178457ea00/0xf7565228e460edd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460edcf expref: 18 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117587.993319:0:16931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c178442f000/0xf7565228e460ee4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460ee46 expref: 18 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117587.993327:0:16931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1787cbca00/0xf7565228e460f030 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb8f expref: 12 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117587.993334:0:16931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1787cbd200/0xf7565228e460f068 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cbf1 expref: 12 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117587.993341:0:16931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c178457f000/0xf7565228e460f092 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117587.993391:0:16931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1787cbd200/0xf7565228e460f068 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cbf1 expref: 12 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117587.993497:0:16931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1787cbd200/0xf7565228e460f068 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cbf1 expref: 12 pid: 14812 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117587.993513:0:16931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681ef3840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16931:1876025385522560:192.168.206.37@tcp:104: 00010000:00010000:2.0:1789117587.993633:0:16931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1787cbca00/0xf7565228e460f030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb8f expref: 12 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117587.993642:0:16931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1787cbca00/0xf7565228e460f030 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb8f expref: 12 pid: 14809 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117587.993658:0:16931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681ef30c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16931:1876025385522688:192.168.206.37@tcp:104: 00010000:00010000:2.0:1789117587.993702:0:16931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178442f000/0xf7565228e460ee4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460ee46 expref: 18 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117587.993710:0:16931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c178442f000/0xf7565228e460ee4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460ee46 expref: 18 pid: 14810 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117587.993720:0:16931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681ef0b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16931:1876025385522816:0@lo:104: 00000100:00100000:2.0:1789117587.993763:0:16931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789117587.993811:0:16931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c178457ea00/0xf7565228e460edd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460edcf expref: 18 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117587.993820:0:16931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c178457ea00/0xf7565228e460edd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460edcf expref: 18 pid: 14810 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117587.993828:0:16931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681ef21c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16931:1876025385522944:0@lo:104: 00000100:00100000:2.0:1789117587.993849:0:16931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789117587.993876:0:16931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1787cbcc00/0xf7565228e460ed89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7565228e460ed82 expref: 18 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117587.993885:0:16931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1787cbcc00/0xf7565228e460ed89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7565228e460ed82 expref: 18 pid: 14812 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117587.993903:0:16931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681ef1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16931:1876025385523072:0@lo:104: 00000100:00100000:2.0:1789117587.993937:0:16931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117587.993948:0:16931:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178720e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789117587.994192:0:14800:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789117587.994204:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385522816 00000100:00100000:1.0:1789117587.994210:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385522816 00000100:00100000:1.0:1789117587.994243:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385522944 00000100:00100000:1.0:1789117587.994246:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385522944 00000100:00100000:1.0:1789117587.994256:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385523072 00000100:00100000:1.0:1789117587.994258:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385523072 00000100:00100000:1.0:1789117587.994271:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789117587.994279:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+5:16931:x1876025385522816:12345-0@lo:104: 00010000:00010000:1.0:1789117587.994291:0:14800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460ee46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460ee4d expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117587.994352:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789117587.994358:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+5:16931:x1876025385522816:12345-0@lo:104: Request processed in 80us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117587.994365:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789117587.994395:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789117587.994431:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+4:16931:x1876025385522944:12345-0@lo:104: 00010000:00010000:1.0:1789117587.994444:0:14800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c178442e400/0xf7565228e460edcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460edd6 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117587.994496:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789117587.994501:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+4:16931:x1876025385522944:12345-0@lo:104: Request processed in 73us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117587.994507:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789117587.994521:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789117587.994528:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bfa9d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+3:16931:x1876025385523072:12345-0@lo:104: 00010000:00010000:1.0:1789117587.994536:0:14800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.137@tcp lock: ffff9c16829c6600/0xf7565228e460ed82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460ed89 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117587.994570:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789117587.994574:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bfa9d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+3:16931:x1876025385523072:12345-0@lo:104: Request processed in 48us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117587.994580:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789117587.994617:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789117587.994622:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460ee46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460ee4d expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117587.994629:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457fc00 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:1.0:1789117587.994633:0:14806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460ee46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460ee4d expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117587.994641:0:14806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460ee46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460ee4d expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117587.994648:0:14806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460ee46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460ee4d expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117587.994654:0:14806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789117587.994689:0:14806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460ee46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460ee4d expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117587.994696:0:14806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789117587.994716:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460ee46 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460ee4d expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117587.994722:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178457fc00/0xf7565228e460ee46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460ee4d expref: -99 pid: 16222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117587.994735:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789117587.994738:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c178442e400/0xf7565228e460edcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460edd6 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117587.994744:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e400 already unused, calling callback (ffffffffc1ce7c20) 10000000:00010000:1.0:1789117587.994747:0:14806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c178442e400/0xf7565228e460edcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460edd6 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117587.994753:0:14806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c178442e400/0xf7565228e460edcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460edd6 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789117587.994759:0:14806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c178442e400/0xf7565228e460edcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460edd6 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789117587.994765:0:14806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789117587.994778:0:14806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c178442e400/0xf7565228e460edcf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460edd6 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117587.994783:0:14806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789117587.994789:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789117587.994791:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c178442e400/0xf7565228e460edcf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460edd6 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117587.994797:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.137@tcp lock: ffff9c16829c6600/0xf7565228e460ed82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7565228e460ed89 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117587.994812:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c6600 already unused, calling callback (ffffffffc1ce7c20) 00010000:00010000:1.0:1789117587.994819:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c178442e400/0xf7565228e460edcf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460edd6 expref: -99 pid: 15500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789117587.994819:0:14805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.137@tcp lock: ffff9c16829c6600/0xf7565228e460ed82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7565228e460ed89 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117587.994840:0:14805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.137@tcp lock: ffff9c16829c6600/0xf7565228e460ed82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7565228e460ed89 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117587.994843:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117587.994846:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117587.994848:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1789117587.994857:0:14805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.137@tcp lock: ffff9c16829c6600/0xf7565228e460ed82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7565228e460ed89 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117587.994863:0:14805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789117587.994864:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3300:1876025385523200:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789117587.994889:0:14805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.137@tcp lock: ffff9c16829c6600/0xf7565228e460ed82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460ed89 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117587.994897:0:14805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789117587.994904:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789117587.994918:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.137@tcp lock: ffff9c16829c6600/0xf7565228e460ed82 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460ed89 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117587.994926:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.137@tcp lock: ffff9c16829c6600/0xf7565228e460ed82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7565228e460ed89 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117587.994941:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117587.994943:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117587.994944:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117587.994950:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117587.994963:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3298:1876025385523456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789117587.995274:0:16931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681ef0b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16931:1876025385522816:0@lo:104: 00000100:00100000:2.0:1789117587.995282:0:16931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681ef21c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16931:1876025385522944:0@lo:104: 00000100:00100000:2.0:1789117587.995297:0:16931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681ef1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16931:1876025385523072:0@lo:104: 00000100:00100000:2.0:1789117587.995725:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385523200 00000100:00100000:2.0:1789117587.995731:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385523200 00010000:00010000:2.0:1789117587.995757:0:14804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178442f000/0xf7565228e460ee4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460ee46 expref: 19 pid: 14810 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117587.995789:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789117587.995796:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:3300:x1876025385523200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789117587.995806:0:14804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117587.995811:0:14804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178442f000/0xf7565228e460ee4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460ee46 expref: 19 pid: 14810 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117587.995820:0:14804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178442f000/0xf7565228e460ee4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460ee46 expref: 19 pid: 14810 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117587.995833:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178442f000/0xf7565228e460ee4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460ee46 expref: 19 pid: 14810 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117587.995845:0:14804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117587.996087:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117587.996149:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789117587.996157:0:14802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789117587.996283:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385523456 00000100:00100000:0.0:1789117587.996288:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385523456 00010000:00010000:0.0:1789117587.996308:0:14802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1787cbcc00/0xf7565228e460ed89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460ed82 expref: 19 pid: 14812 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117587.996329:0:14802:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789117587.996336:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789117587.996342:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02561c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:3298:x1876025385523456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789117587.996357:0:14802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117587.996362:0:14802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1787cbcc00/0xf7565228e460ed89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460ed82 expref: 19 pid: 14812 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117587.996370:0:14802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1787cbcc00/0xf7565228e460ed89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460ed82 expref: 19 pid: 14812 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117587.996397:0:14802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1787cbcc00/0xf7565228e460ed89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460ed82 expref: 19 pid: 14812 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117587.996430:0:14802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117587.996462:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02561c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+18:3298:x1876025385523456:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117587.996470:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789117587.996502:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3298:1876025385523456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117587.997750:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117587.997764:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3300:1876025385523328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117587.997813:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117587.997888:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385523328 00000100:00100000:0.0:1789117587.998008:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385523328 00010000:00010000:0.0:1789117587.998037:0:14802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c178457ea00/0xf7565228e460edd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460edcf expref: 18 pid: 14810 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117587.998075:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789117587.998085:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1787264450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+18:3300:x1876025385523328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789117587.998098:0:14802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117587.998104:0:14802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c178457ea00/0xf7565228e460edd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7565228e460edcf expref: 18 pid: 14810 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117587.998115:0:14802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c178457ea00/0xf7565228e460edd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7565228e460edcf expref: 18 pid: 14810 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117587.998146:0:14802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178457ea00/0xf7565228e460edd6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7565228e460edcf expref: 18 pid: 14810 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117587.998159:0:14802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117587.998244:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1787264450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+17:3300:x1876025385523328:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117587.998251:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789117587.998369:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:3300:x1876025385523200:12345-0@lo:103:ldlm_bl.0 Request processed in 2572us (3465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117587.998387:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789117587.998485:0:16931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681ef3840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16931:1876025385522560:192.168.206.37@tcp:104: 00000100:00100000:2.0:1789117587.998497:0:16931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681ef30c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16931:1876025385522688:192.168.206.37@tcp:104: 00010000:00010000:2.0:1789117587.998522:0:16931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c178457f000/0xf7565228e460f092 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117587.999093:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3300:1876025385523328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789117587.999105:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3300:1876025385523200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789117587.999180:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117587.999288:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117587.999738:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362464384 00000100:00100000:3.0:1789117587.999745:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362464384 00010000:00010000:3.0:1789117587.999776:0:14803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1787cbd200/0xf7565228e460f068 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cbf1 expref: 13 pid: 14812 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117587.999806:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362464512 00000100:00100000:3.0:1789117587.999809:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362464512 00010000:00010000:3.0:1789117587.999822:0:14803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1787cbca00/0xf7565228e460f030 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb8f expref: 14 pid: 14809 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117587.999876:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 7 00000100:00100000:3.0:1789117587.999886:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+14:2350:x1876025362464384:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117588.000050:0:14803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117588.000057:0:14803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1787cbd200/0xf7565228e460f068 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cbf1 expref: 14 pid: 14812 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.000069:0:14803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1787cbd200/0xf7565228e460f068 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cbf1 expref: 14 pid: 14812 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.000099:0:14803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1787cbd200/0xf7565228e460f068 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cbf1 expref: 14 pid: 14812 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.000110:0:14803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117588.000161:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:2350:x1876025362464384:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 276us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117588.000169:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 7 00000100:00100000:3.0:1789117588.000184:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 8 00000100:00100000:3.0:1789117588.000191:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+12:2352:x1876025362464512:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117588.000199:0:14803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117588.000203:0:14803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1787cbca00/0xf7565228e460f030 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb8f expref: 12 pid: 14809 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.000211:0:14803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1787cbca00/0xf7565228e460f030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb8f expref: 12 pid: 14809 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.000220:0:14803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1787cbca00/0xf7565228e460f030 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cb8f expref: 12 pid: 14809 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.000229:0:14803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c178457f000/0xf7565228e460f092 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.000236:0:14803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178457f000/0xf7565228e460f092 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.000250:0:14803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178457f000/0xf7565228e460f092 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.000267:0:14803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c178457f000/0xf7565228e460f092 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.000274:0:14803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c178457f000/0xf7565228e460f092 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.000280:0:14803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c178457f000/0xf7565228e460f092 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.000287:0:14803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457f000 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117588.000291:0:14803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c178457f000/0xf7565228e460f092 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.000299:0:14803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c178457f000/0xf7565228e460f092 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.000315:0:14803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c178457f000/0xf7565228e460f092 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117588.000326:0:14803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117588.000349:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+11:2352:x1876025362464512:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 158us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117588.000356:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 8 00010000:00010000:2.0:1789117588.000449:0:16931:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c178457f000/0xf7565228e460f092 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117588.000465:0:16931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c178457f000/0xf7565228e460f092 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117588.000471:0:16931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c178457f000/0xf7565228e460f092 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117588.104322:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117589.125562:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789117589.318293:0:14815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789117589.318301:0:14815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c178548a000 from 13 10000000:01000000:2.0:1789117589.318307:0:14815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789117589.318347:0:14815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460f099 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117589.318358:0:14815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460f099 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117589.318379:0:14815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460f099 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117589.318587:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681ef30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385523584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789117589.318649:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117589.318728:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17870ec540 going to sleep for 11 seconds 00000100:00100000:0.0:1789117589.318765:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385523584 00000100:00100000:0.0:1789117589.318772:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385523584 00000100:00100000:0.0:1789117589.318845:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789117589.318869:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+16:14815:x1876025385523584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117589.318881:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117589.318897:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1787cbde00/0xf7565228e460f0a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460f099 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117589.319141:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1787cbde00/0xf7565228e460f0a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460f099 expref: 17 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117589.319154:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1787cbde00/0xf7565228e460f0a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460f099 expref: 17 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117589.319163:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbde00, rc 0) 00000100:00100000:0.0:1789117589.319206:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+17:14815:x1876025385523584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 353us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117589.319212:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789117589.319344:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681ef30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385523584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117589.319376:0:14815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460f099 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460f0a0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117589.319385:0:14815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460f099 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460f0a0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117589.319773:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02552c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385523712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117589.319804:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117589.319835:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1784c6f600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117589.319884:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385523712 00000100:00100000:3.0:1789117589.319898:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385523712 00000100:00100000:3.0:1789117589.319963:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789117589.319978:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+17:14815:x1876025385523712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117589.320607:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+17:14815:x1876025385523712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 632us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117589.320630:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789117589.320679:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02552c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385523712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117589.320727:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02552c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385523840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789117589.321282:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117589.321331:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1784c6f600 going to sleep for 11 seconds 00000100:00100000:3.0:1789117589.322078:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385523840 00000100:00100000:3.0:1789117589.322092:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385523840 00000100:00100000:3.0:1789117589.322276:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789117589.322290:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+17:14815:x1876025385523840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117589.322591:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+17:14815:x1876025385523840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 304us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117589.322598:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789117589.322664:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02552c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385523840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789117589.324837:0:16985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789117589.325084:0:14815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789117589.325116:0:14815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789117589.325126:0:14815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460f099 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460f0a0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117589.325137:0:14815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c178457e400/0xf7565228e460f099 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460f0a0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789117589.325148:0:14815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789117589.325150:0:14815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c17c03a5000 from 13 10000000:01000000:0.0:1789117589.325153:0:14815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789117589.325190:0:14815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1787cbd800/0xf7565228e460f0a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117589.325209:0:14815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c1787cbd800/0xf7565228e460f0a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117589.325221:0:14815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c1787cbd800/0xf7565228e460f0a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117589.325245:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02552c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385523968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789117589.325311:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117589.325378:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17831513c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117589.326293:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385523968 00000100:00100000:0.0:1789117589.326302:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385523968 00000100:00100000:0.0:1789117589.326424:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789117589.326435:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+17:14815:x1876025385523968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789117589.326450:0:14812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117589.326465:0:14812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1787cbcc00/0xf7565228e460f0ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460f0a7 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117589.326488:0:14812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1787cbcc00/0xf7565228e460f0ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460f0a7 expref: 18 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117589.326498:0:14812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1787cbcc00/0xf7565228e460f0ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460f0a7 expref: 18 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117589.326506:0:14812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbcc00, rc 0) 00000100:00100000:0.0:1789117589.326571:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+18:14815:x1876025385523968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117589.326577:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789117589.327008:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02552c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385523968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117589.327042:0:14815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c1787cbd800/0xf7565228e460f0a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460f0ae expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117589.328099:0:14815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c1787cbd800/0xf7565228e460f0a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460f0ae expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117589.328344:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7c90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385524096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117589.328658:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117589.328790:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681f1d480 going to sleep for 11 seconds 00000100:00100000:0.0:1789117589.331015:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385524096 00000100:00100000:0.0:1789117589.331033:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385524096 00000100:00100000:0.0:1789117589.331271:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789117589.331286:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+18:14815:x1876025385524096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117589.331835:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+18:14815:x1876025385524096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 550us (3174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117589.331847:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789117589.332293:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7c90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385524096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117589.332394:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7c90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385524224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117589.332501:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117589.332563:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681f1d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789117589.332678:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385524224 00000100:00100000:2.0:1789117589.332692:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385524224 00000100:00100000:2.0:1789117589.332752:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789117589.332763:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+18:14815:x1876025385524224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789117589.333101:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+18:14815:x1876025385524224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 340us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117589.333121:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789117589.333311:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7c90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385524224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789117589.334720:0:16986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789117589.335702:0:14815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789117589.335743:0:14815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789117589.336284:0:14815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c1787cbd800/0xf7565228e460f0a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460f0ae expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117589.336300:0:14815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c1787cbd800/0xf7565228e460f0a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460f0ae expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789117589.336313:0:14815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789117589.336317:0:14815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1683d8b800 from 13 10000000:01000000:3.0:1789117589.336320:0:14815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789117589.336377:0:14815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c16829c6e00/0xf7565228e460f0b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117589.336387:0:14815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.137@tcp lock: ffff9c16829c6e00/0xf7565228e460f0b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117589.336485:0:14815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.137@tcp lock: ffff9c16829c6e00/0xf7565228e460f0b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117589.336520:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7c90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385524352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789117589.336602:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117589.336805:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681f1df00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117589.338234:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385524352 00000100:00100000:0.0:1789117589.338247:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385524352 00000100:00100000:1.0:1789117589.338592:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789117589.338607:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+18:14815:x1876025385524352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117589.338624:0:14810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117589.338644:0:14810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178442e000/0xf7565228e460f0bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7565228e460f0b5 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117589.338671:0:14810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178442e000/0xf7565228e460f0bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7565228e460f0b5 expref: 19 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117589.338682:0:14810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178442e000/0xf7565228e460f0bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7565228e460f0b5 expref: 19 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117589.338691:0:14810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e000, rc 0) 00000100:00100000:1.0:1789117589.338764:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:14815:x1876025385524352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (2162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117589.338785:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789117589.338824:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7c90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385524352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789117589.338857:0:14815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.137@tcp lock: ffff9c16829c6e00/0xf7565228e460f0b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460f0bc expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117589.338870:0:14815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.137@tcp lock: ffff9c16829c6e00/0xf7565228e460f0b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7565228e460f0bc expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117589.339811:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7c90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385524480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117589.339903:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117589.339958:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681f1df00 going to sleep for 11 seconds 00000100:00100000:0.0:1789117589.340232:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385524480 00000100:00100000:0.0:1789117589.340241:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385524480 00000100:00100000:0.0:1789117589.340304:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789117589.340314:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:14815:x1876025385524480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789117589.342292:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:14815:x1876025385524480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1967us (2378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117589.342442:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789117589.346122:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7c90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385524480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789117589.346256:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7c90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385524608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117589.346355:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117589.346457:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681f1df00 going to sleep for 11 seconds 00000100:00100000:3.0:1789117589.346481:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385524608 00000100:00100000:3.0:1789117589.346489:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385524608 00000100:00100000:3.0:1789117589.346566:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789117589.346577:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:14815:x1876025385524608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117589.347252:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:14815:x1876025385524608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 673us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117589.347262:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789117589.347329:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7c90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:14815:1876025385524608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789117589.349628:0:16987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789117589.350479:0:14815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789117589.350521:0:14815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789117589.350533:0:14815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.137@tcp lock: ffff9c16829c6e00/0xf7565228e460f0b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460f0bc expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117589.350545:0:14815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.137@tcp lock: ffff9c16829c6e00/0xf7565228e460f0b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7565228e460f0bc expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117589.537890:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117589.537986:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362464640 00000100:00100000:1.0:1789117589.537995:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362464640 00000100:00100000:1.0:1789117589.538047:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 114 00000100:00100000:1.0:1789117589.538057:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+11:13975:x1876025362464640:12345-192.168.206.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117589.538073:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117589.538091:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178442e600/0xf7565228e460f0c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cc22 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117589.538118:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178442e600/0xf7565228e460f0c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc22 expref: 12 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117589.538129:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178442e600/0xf7565228e460f0c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc22 expref: 12 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117589.538138:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e600, rc 0) 00000100:00100000:1.0:1789117589.538193:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+12:13975:x1876025362464640:12345-192.168.206.37@tcp:101:ll_cfg_requeue.0 Request processed in 138us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117589.538200:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 114 00000100:00100000:1.0:1789117589.548019:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117589.548056:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362464768 00000100:00100000:1.0:1789117589.548065:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362464768 00000100:00100000:1.0:1789117589.548109:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 115 00000100:00100000:1.0:1789117589.548118:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+12:13975:x1876025362464768:12345-192.168.206.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789117589.551744:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+12:13975:x1876025362464768:12345-192.168.206.37@tcp:501:ll_cfg_requeue.0 Request processed in 3618us (3725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117589.551758:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 115 00000100:00100000:0.0:1789117589.560867:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117589.561003:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362464896 00000100:00100000:3.0:1789117589.561014:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362464896 00000100:00100000:3.0:1789117589.561069:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 116 00000100:00100000:3.0:1789117589.561079:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+12:13975:x1876025362464896:12345-192.168.206.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117589.561338:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+12:13975:x1876025362464896:12345-192.168.206.37@tcp:503:ll_cfg_requeue.0 Request processed in 258us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117589.561345:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 116 00000100:00100000:3.0:1789117589.573105:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117589.573475:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362465024 00000100:00100000:1.0:1789117589.573484:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362465024 00000100:00100000:1.0:1789117589.573535:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 117 00000100:00100000:1.0:1789117589.573545:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+12:13975:x1876025362465024:12345-192.168.206.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789117589.573560:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117589.573575:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c178442e400/0xf7565228e460f0ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cc29 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117589.573606:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c178442e400/0xf7565228e460f0ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc29 expref: 13 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117589.573617:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c178442e400/0xf7565228e460f0ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc29 expref: 13 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117589.573626:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e400, rc 0) 00000100:00100000:1.0:1789117589.580671:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:13975:x1876025362465024:12345-192.168.206.37@tcp:101:ll_cfg_requeue.0 Request processed in 7116us (7565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117589.580685:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 117 00000100:00100000:2.0:1789117589.588217:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117589.588251:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362465152 00000100:00100000:2.0:1789117589.588259:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362465152 00000100:00100000:2.0:1789117589.588302:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 118 00000100:00100000:2.0:1789117589.588311:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:13975:x1876025362465152:12345-192.168.206.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789117589.588579:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:13975:x1876025362465152:12345-192.168.206.37@tcp:501:ll_cfg_requeue.0 Request processed in 267us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117589.588587:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 118 00000100:00100000:1.0:1789117589.591341:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117589.591938:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362465280 00000100:00100000:3.0:1789117589.591950:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362465280 00000100:00100000:3.0:1789117589.592003:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 119 00000100:00100000:3.0:1789117589.592013:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:13975:x1876025362465280:12345-192.168.206.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789117589.592213:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:13975:x1876025362465280:12345-192.168.206.37@tcp:503:ll_cfg_requeue.0 Request processed in 200us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117589.592221:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 119 00010000:00010000:0.0:1789117590.149697:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117591.173975:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117591.622828:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117591.622860:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385524736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117591.622929:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117591.623172:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385524736 00000100:00100000:1.0:1789117591.623180:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385524736 00000100:00100000:1.0:1789117591.623238:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789117591.623247:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c92940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385524736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789117591.623278:0:15506:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117591.623324:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c92940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385524736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117591.623331:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789117591.623491:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117591.623530:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385524736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117591.625580:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385524864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117591.625645:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117591.626118:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385524864 00000100:00100000:0.0:1789117591.626126:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385524864 00000100:00100000:0.0:1789117591.626184:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789117591.626194:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385524864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789117591.626230:0:15506:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789117591.626421:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385525248:0@lo:400:kworker.0 00000100:00100000:2.0:1789117591.626496:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3301:1876025385524992:0@lo:400:kworker.0 00000100:00100000:0.0:1789117591.628222:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876025385524864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2023us (2569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117591.628235:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789117591.628283:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117591.628325:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876025385525120:0@lo:400:kworker.0 00000100:00100000:0.0:1789117591.628380:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117591.628443:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385525120 00000100:00100000:0.0:1789117591.628450:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385525120 00000100:00100000:0.0:1789117591.628486:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789117591.628494:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0255680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876025385525120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117591.628540:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0255680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876025385525120:12345-0@lo:400:kworker.0 Request processed in 47us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117591.628547:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789117591.628580:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876025385525120:0@lo:400:kworker.0 00000100:00100000:3.0:1789117591.629134:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876025385524864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117591.629153:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876025385525376:0@lo:400:kworker.0 00000100:00100000:3.0:1789117591.629184:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117591.629217:0:15529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385525376 00000100:00100000:3.0:1789117591.629221:0:15529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385525376 00000100:00100000:3.0:1789117591.629254:0:15529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789117591.629262:0:15529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876025385525376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117591.629299:0:15529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876025385525376:12345-0@lo:400:kworker.0 Request processed in 38us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117591.629305:0:15529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1789117591.629335:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117591.629351:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876025385525376:0@lo:400:kworker.0 00000100:00100000:1.0:1789117591.634760:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117591.634960:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117591.635147:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385524992 00000100:00100000:1.0:1789117591.635155:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385524992 00000100:00100000:1.0:1789117591.635204:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789117591.635213:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:3301:x1876025385524992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117591.635265:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:3301:x1876025385524992:12345-0@lo:400:kworker.0 Request processed in 54us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117591.635272:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789117591.635374:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3301:1876025385524992:0@lo:400:kworker.0 00000100:00100000:3.0:1789117591.636119:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385525248 00000100:00100000:3.0:1789117591.636126:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385525248 00000100:00100000:3.0:1789117591.636176:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789117591.636185:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385525248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117591.636243:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876025385525248:12345-0@lo:400:kworker.0 Request processed in 59us (1491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117591.636250:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789117591.636323:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876025385525248:0@lo:400:kworker.0 00000100:00080000:0.0:1789117591.636453:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117591.721489:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117591.721531:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117591.721564:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117591.721590:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117591.721611:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117591.721630:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117591.721650:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117591.721686:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362465920 00000100:00100000:3.0:1789117591.721694:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362465920 00000100:00100000:1.0:1789117591.722001:0:15501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362465664 00000100:00100000:1.0:1789117591.722006:0:15501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362465664 00000100:00100000:1.0:1789117591.722043:0:15501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362466176 00000100:00100000:1.0:1789117591.722045:0:15501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362466176 00000100:00100000:1.0:1789117591.722057:0:15501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362465792 00000100:00100000:1.0:1789117591.722059:0:15501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362465792 00000100:00100000:1.0:1789117591.722070:0:15501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362466048 00000100:00100000:1.0:1789117591.722072:0:15501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362466048 00000100:00100000:1.0:1789117591.722088:0:15501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 6 00000100:00100000:1.0:1789117591.722096:0:15501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+5:2351:x1876025362465664:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117591.722168:0:15501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+5:2351:x1876025362465664:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 72us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117591.722188:0:15501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 6 00000100:00100000:1.0:1789117591.722206:0:15501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 7 00000100:00100000:1.0:1789117591.722212:0:15501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28194745-e310-497c-8221-affa7d89f6fa+5:2351:x1876025362466176:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117591.722239:0:15501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28194745-e310-497c-8221-affa7d89f6fa+5:2351:x1876025362466176:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 28us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117591.722244:0:15501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 7 00000100:00100000:1.0:1789117591.722255:0:15501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 8 00000100:00100000:1.0:1789117591.722260:0:15501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+5:2351:x1876025362465792:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117591.722281:0:15501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+5:2351:x1876025362465792:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 21us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117591.722287:0:15501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 8 00000100:00100000:1.0:1789117591.722297:0:15501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 9 00000100:00100000:1.0:1789117591.722303:0:15501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be72580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28194745-e310-497c-8221-affa7d89f6fa+5:2351:x1876025362466048:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117591.722324:0:15501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be72580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28194745-e310-497c-8221-affa7d89f6fa+5:2351:x1876025362466048:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 20us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117591.722329:0:15501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 9 00000100:00100000:1.0:1789117591.722513:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362465536 00000100:00100000:1.0:1789117591.722518:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362465536 00000100:00100000:1.0:1789117591.722547:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 24 00000100:00100000:1.0:1789117591.722554:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+6:2351:x1876025362465536:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:1.0:1789117591.722587:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+6:2351:x1876025362465536:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 33us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117591.722593:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 24 00000100:00080000:1.0:1789117591.722652:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789117591.722656:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789117591.722659:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117591.722880:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362465408 00000100:00100000:2.0:1789117591.722886:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362465408 00000100:00100000:2.0:1789117591.722919:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 121 00000100:00100000:2.0:1789117591.722927:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbcce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:2351:x1876025362465408:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117591.722961:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbcce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:2351:x1876025362465408:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 35us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117591.722968:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 121 00000100:00100000:3.0:1789117591.725154:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 25 00000100:00100000:3.0:1789117591.725172:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28194745-e310-497c-8221-affa7d89f6fa+6:2351:x1876025362465920:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:3.0:1789117591.725960:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28194745-e310-497c-8221-affa7d89f6fa+6:2351:x1876025362465920:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 789us (4389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117591.725970:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 25 00000100:00100000:1.0:1789117591.897725:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117591.897858:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362466304 00000100:00100000:3.0:1789117591.897868:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362466304 00000100:00100000:3.0:1789117591.897929:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 15 00000100:00100000:3.0:1789117591.897949:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+6:14632:x1876025362466304:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789117591.897982:0:14819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117591.898002:0:14819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f0d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cc30 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.898180:0:14819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6800/0xf7565228e460f0d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.898195:0:14819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6800/0xf7565228e460f0d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.898207:0:14819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6800/0xf7565228e460f0d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.898221:0:14819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f0df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.898229:0:14819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f0df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.898381:0:14819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f0df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.900115:0:14819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7e00/0xf7565228e460f0e6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.900133:0:14819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7e00/0xf7565228e460f0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.900143:0:14819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7e00/0xf7565228e460f0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117591.900773:0:14819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1789117591.900787:0:14819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1789117591.900907:0:14819:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7e00/0xf7565228e460f0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.900921:0:14819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6800/0xf7565228e460f0d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.900928:0:14819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6800/0xf7565228e460f0d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.900935:0:14819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6800/0xf7565228e460f0d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.900951:0:14819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c6800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117591.900956:0:14819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6800/0xf7565228e460f0d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.900964:0:14819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6800/0xf7565228e460f0d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.900978:0:14819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782c0ea00) 00010000:00010000:3.0:1789117591.900982:0:14819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117591.900986:0:14819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6800/0xf7565228e460f0d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.900991:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6800/0xf7565228e460f0d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.901846:0:14819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f0df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.901858:0:14819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f0df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.901880:0:14819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f0df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.901885:0:14819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c7800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117591.901889:0:14819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f0df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.901896:0:14819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f0df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.901908:0:14819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c1782df4e00) 00010000:00010000:3.0:1789117591.901911:0:14819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117591.901915:0:14819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f0df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.901921:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f0df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.901979:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f0d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc30 expref: 8 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.901994:0:14819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7e00/0xf7565228e460f0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc30 expref: 7 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.902001:0:14819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c1782df4b00) 00010000:00010000:3.0:1789117591.902013:0:14819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789117591.902016:0:14819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c16829c7e00, rc 0) 00000100:00100000:3.0:1789117591.902087:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+7:14632:x1876025362466304:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 4150us (4372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117591.902104:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 15 00000100:00100000:0.0:1789117591.914440:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117591.914532:0:15529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362466560 00000100:00100000:1.0:1789117591.914542:0:15529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362466560 00000100:00100000:1.0:1789117591.914602:0:15529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 16 00000100:00100000:1.0:1789117591.914613:0:15529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0255a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+7:14632:x1876025362466560:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789117591.914642:0:15529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117591.914665:0:15529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f0ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cc37 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.914734:0:15529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460f0f4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.914749:0:15529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460f0f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.914764:0:15529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460f0f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.914827:0:15529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f0fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.914834:0:15529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f0fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.914841:0:15529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f0fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.917801:0:15529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460f102 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.917828:0:15529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460f102 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.917839:0:15529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460f102 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117591.917852:0:15529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1789117591.918100:0:15529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460f0f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.918108:0:15529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460f0f4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.918115:0:15529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460f0f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.918122:0:15529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442ee00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117591.918126:0:15529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460f0f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.918133:0:15529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460f0f4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.918145:0:15529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c1782df4b00) 00010000:00010000:1.0:1789117591.918148:0:15529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117591.918153:0:15529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460f0f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.918160:0:15529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460f0f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.918172:0:15529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f0fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.918183:0:15529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f0fb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.918189:0:15529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f0fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.918193:0:15529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117591.918196:0:15529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f0fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.918201:0:15529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f0fb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.918208:0:15529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c1788d9e000) 00010000:00010000:1.0:1789117591.918211:0:15529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117591.918213:0:15529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f0fb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.918219:0:15529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f0fb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.918648:0:15529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f0ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc37 expref: 10 pid: 15529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.918663:0:15529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442fe00/0xf7565228e460f102 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc37 expref: 9 pid: 15529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117591.918670:0:15529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1788d9e600) 00010000:00010000:1.0:1789117591.918673:0:15529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117591.918681:0:15529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442fe00, rc 0) 00000100:00100000:1.0:1789117591.918753:0:15529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0255a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+9:14632:x1876025362466560:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 4141us (4320us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789117591.918763:0:15529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 16 00000100:00100000:2.0:1789117591.922481:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117591.922922:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362466688 00000100:00100000:1.0:1789117591.922931:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362466688 00000100:00100000:1.0:1789117591.922995:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 17 00000100:00100000:1.0:1789117591.923522:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+9:14632:x1876025362466688:12345-192.168.206.37@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789117591.923636:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+9:14632:x1876025362466688:12345-192.168.206.37@tcp:59:lhsmtool_posix.0 Request processed in 617us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117591.923644:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 17 00000100:00100000:3.0:1789117591.961547:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117591.961853:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362466816 00000100:00100000:0.0:1789117591.961862:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362466816 00000100:00100000:0.0:1789117591.961922:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 18 00000100:00100000:0.0:1789117591.961932:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+9:14638:x1876025362466816:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:0.0:1789117591.961961:0:14817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117591.961981:0:14817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f110 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cc3e expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962053:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460f117 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962068:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460f117 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962079:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460f117 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962108:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f11e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962116:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f11e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962130:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f11e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962389:0:14817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460f117 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962434:0:14817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460f117 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962442:0:14817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460f117 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962448:0:14817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbca00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117591.962452:0:14817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460f117 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962460:0:14817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460f117 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962472:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782c0ea00) 00010000:00010000:0.0:1789117591.962475:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117591.962480:0:14817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460f117 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962487:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460f117 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962507:0:14817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f11e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962513:0:14817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f11e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962519:0:14817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f11e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962524:0:14817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117591.962527:0:14817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f11e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962533:0:14817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f11e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962540:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c1782c0e800) 00010000:00010000:0.0:1789117591.962542:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117591.962545:0:14817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f11e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962550:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f11e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962581:0:14817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f110 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc3e expref: 10 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962591:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782c0ea00) 00010000:00010000:0.0:1789117591.962593:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117591.962604:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f110 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc3e expref: 10 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.962614:0:14817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbd200, rc 0) 00000100:00100000:0.0:1789117591.962692:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+9:14638:x1876025362466816:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 760us (1152us total) trans 0 rc 301/301 00000100:00100000:0.0:1789117591.962699:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 18 00000100:00100000:0.0:1789117591.967530:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117591.967722:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362466944 00000100:00100000:1.0:1789117591.967732:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362466944 00000100:00100000:1.0:1789117591.967783:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 0 00000100:00100000:1.0:1789117591.967793:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+9:14638:x1876025362466944:12345-192.168.206.37@tcp:700:lfs.0 00000100:00100000:1.0:1789117591.967927:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+9:14638:x1876025362466944:12345-192.168.206.37@tcp:700:lfs.0 Request processed in 133us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117591.967935:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 0 00000100:00100000:2.0:1789117591.970319:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117591.970470:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362467200 00000100:00100000:3.0:1789117591.970478:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362467200 00000100:00100000:3.0:1789117591.970528:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 19 00000100:00100000:3.0:1789117591.970536:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+9:14638:x1876025362467200:12345-192.168.206.37@tcp:36:lfs.0 00010000:00010000:3.0:1789117591.970583:0:14819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117591.970606:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f053 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cbb9 expref: 9 pid: 15529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.970634:0:14819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782c0ea00) 00010000:00010000:3.0:1789117591.970639:0:14819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789117591.970912:0:14819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f125 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.970926:0:14819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f08b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc1b expref: 5 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.970935:0:14819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f125 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.970974:0:14819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f08b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc1b expref: 5 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.970987:0:14819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f08b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc1b expref: 5 pid: 14819 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117591.971000:0:14819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be712c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14819:1876025385525504:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117591.971336:0:14819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c1681f1d540 going to sleep for 11 seconds 00000100:00100000:1.0:1789117591.984704:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117591.987949:0:14819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be712c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14819:1876025385525504:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117591.987981:0:14819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f125 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117591.988116:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362467328 00000100:00100000:2.0:1789117591.988141:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362467328 00010000:00010000:2.0:1789117591.988179:0:14804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f08b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc1b expref: 6 pid: 14819 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117591.988279:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 9 00000100:00100000:2.0:1789117591.988290:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28194745-e310-497c-8221-affa7d89f6fa+6:2350:x1876025362467328:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117591.988315:0:14804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117591.988323:0:14804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f08b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc1b expref: 6 pid: 14819 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117591.988336:0:14804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f08b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc1b expref: 6 pid: 14819 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117591.988371:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f08b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc1b expref: 6 pid: 14819 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117591.988388:0:14804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782c0ea00) 00010000:00010000:2.0:1789117591.988393:0:14804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f125 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117591.988430:0:14804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f125 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117591.988439:0:14804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f125 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117591.988746:0:14804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117591.988808:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28194745-e310-497c-8221-affa7d89f6fa+5:2350:x1876025362467328:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 519us (4114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117591.988827:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 9 00010000:00010000:3.0:1789117591.989665:0:14819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f125 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.989686:0:14819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f125 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.989712:0:14819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f12c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.989724:0:14819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f12c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.989733:0:14819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f12c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117591.991990:0:14819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1789117591.992068:0:14819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f125 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.992080:0:14819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f125 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.992088:0:14819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f125 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.992094:0:14819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c7a00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117591.992098:0:14819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f125 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.992113:0:14819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f125 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.992128:0:14819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782c0ea00) 00010000:00010000:3.0:1789117591.992131:0:14819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117591.992136:0:14819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f125 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117591.992141:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f125 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789117591.992161:0:14819:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000d90ab90 reply state 0000000092ed9e95 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f12c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117591.992170:0:14819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789117591.992601:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+10:14638:x1876025362467200:12345-192.168.206.37@tcp:36:lfs.0 Request processed in 22059us (22292us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789117591.992611:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 19 00010000:00010000:0.0:1789117591.994831:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f12c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.994849:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f12c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.994856:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f12c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.994863:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c7800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117591.994867:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f12c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.994875:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f12c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.994890:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c1782df4e00) 00010000:00010000:0.0:1789117591.994893:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117591.994898:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f12c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117591.994905:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f12c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117592.067434:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117592.067753:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362467456 00000100:00100000:0.0:1789117592.067763:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362467456 00000100:00100000:0.0:1789117592.067823:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 20 00000100:00100000:0.0:1789117592.067834:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+9:14646:x1876025362467456:12345-192.168.206.37@tcp:101:lctl.0 00010000:00010000:0.0:1789117592.067857:0:14817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117592.067879:0:14817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460f133 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cc45 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.067958:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460f13a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.067972:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460f13a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.067984:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460f13a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117592.068046:0:14817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789117592.068050:0:14817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1789117592.068093:0:14817:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460f13a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.068119:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460f133 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc45 expref: 11 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.068137:0:14817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd600/0xf7565228e460f13a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc45 expref: 10 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.068145:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782c0e800) 00010000:00010000:0.0:1789117592.068162:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789117592.068167:0:14817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbd600, rc 0) 00000100:00100000:0.0:1789117592.068231:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+10:14646:x1876025362467456:12345-192.168.206.37@tcp:101:lctl.0 Request processed in 399us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117592.068238:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 20 00000100:00100000:1.0:1789117592.092857:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117592.092954:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362467584 00000100:00100000:3.0:1789117592.092964:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362467584 00000100:00100000:3.0:1789117592.093152:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 21 00000100:00100000:3.0:1789117592.093163:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c01cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28194745-e310-497c-8221-affa7d89f6fa+5:14647:x1876025362467584:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:3.0:1789117592.093180:0:14818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117592.093198:0:14818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f141 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cc4c expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.093266:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6800/0xf7565228e460f148 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.093297:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6800/0xf7565228e460f148 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.093309:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6800/0xf7565228e460f148 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117592.093384:0:14818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789117592.093389:0:14818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1789117592.093453:0:14818:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6800/0xf7565228e460f148 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.093477:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f141 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc4c expref: 7 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.093494:0:14818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6800/0xf7565228e460f148 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc4c expref: 6 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.093502:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782c0e800) 00010000:00010000:3.0:1789117592.093505:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789117592.093509:0:14818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c16829c6800, rc 0) 00000100:00100000:3.0:1789117592.093568:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c01cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28194745-e310-497c-8221-affa7d89f6fa+6:14647:x1876025362467584:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 407us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117592.093575:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 21 00000100:00100000:2.0:1789117592.098964:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117592.099159:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362467712 00000100:00100000:0.0:1789117592.099168:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362467712 00000100:00100000:0.0:1789117592.099275:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 22 00000100:00100000:0.0:1789117592.099286:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28194745-e310-497c-8221-affa7d89f6fa+6:14647:x1876025362467712:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:0.0:1789117592.099306:0:14817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117592.099337:0:14817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460f14f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cc53 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099431:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f156 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099447:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f156 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099457:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f156 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099471:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f15d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099478:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f15d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099483:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f15d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099595:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f164 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099603:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f164 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099610:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f164 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117592.099644:0:14817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1789117592.099647:0:14817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789117592.099685:0:14817:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f164 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099696:0:14817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f156 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099703:0:14817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f156 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099709:0:14817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f156 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099714:0:14817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117592.099719:0:14817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f156 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099726:0:14817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f156 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099738:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782c0e800) 00010000:00010000:0.0:1789117592.099747:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117592.099753:0:14817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f156 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099760:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f156 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099773:0:14817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f15d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099779:0:14817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f15d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099784:0:14817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f15d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099788:0:14817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbda00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117592.099791:0:14817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f15d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099797:0:14817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f15d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099804:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c1782c0ee00) 00010000:00010000:0.0:1789117592.099806:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117592.099809:0:14817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f15d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099814:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f15d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099843:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460f14f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc53 expref: 8 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099869:0:14817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f164 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc53 expref: 7 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.099876:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c1782c0e100) 00010000:00010000:0.0:1789117592.099878:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789117592.099881:0:14817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbd200, rc 0) 00000100:00100000:0.0:1789117592.099953:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28194745-e310-497c-8221-affa7d89f6fa+7:14647:x1876025362467712:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 669us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117592.099961:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 22 00000100:00100000:2.0:1789117592.103133:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117592.103215:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362467968 00000100:00100000:1.0:1789117592.103223:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362467968 00000100:00100000:1.0:1789117592.103344:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 23 00000100:00100000:1.0:1789117592.103364:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28194745-e310-497c-8221-affa7d89f6fa+7:14647:x1876025362467968:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:1.0:1789117592.103384:0:14819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117592.103575:0:14819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f16b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cc5a expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117592.103867:0:14819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1789117592.104121:0:14819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f16b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc5a expref: 9 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.104134:0:14819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782c0e800) 00010000:00010000:1.0:1789117592.104137:0:14819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789117592.104143:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f16b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc5a expref: 9 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.104156:0:14819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e200, rc 0) 00000100:00100000:1.0:1789117592.104335:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28194745-e310-497c-8221-affa7d89f6fa+8:14647:x1876025362467968:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 982us (1210us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1789117592.104343:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 23 00000100:00100000:2.0:1789117592.108914:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117592.109778:0:15529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362468224 00000100:00100000:3.0:1789117592.109788:0:15529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362468224 00000100:00100000:3.0:1789117592.109876:0:15529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 24 00000100:00100000:3.0:1789117592.109887:0:15529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28194745-e310-497c-8221-affa7d89f6fa+8:14647:x1876025362468224:12345-192.168.206.37@tcp:36:lfs.0 00010000:00010000:3.0:1789117592.110064:0:15529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117592.110099:0:15529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f164 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc53 expref: 8 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.110119:0:15529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c1782c0e100) 00010000:00010000:3.0:1789117592.110129:0:15529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789117592.110152:0:15529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f179 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.110165:0:15529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f179 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.110175:0:15529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f179 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789117592.110541:0:15529:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e931993a reply state 00000000a90d679d transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f179 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117592.110552:0:15529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789117592.110564:0:15529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1789117592.110708:0:15529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28194745-e310-497c-8221-affa7d89f6fa+9:14647:x1876025362468224:12345-192.168.206.37@tcp:36:lfs.0 Request processed in 822us (1801us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789117592.110717:0:15529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 24 00010000:00010000:1.0:1789117592.112735:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f179 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.112751:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f179 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.112758:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f179 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.112765:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c7a00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117592.112770:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f179 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.112778:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f179 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.112807:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c1782df4100) 00010000:00010000:1.0:1789117592.112810:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789117592.112815:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f179 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.112822:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f179 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117592.113492:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117592.114504:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362468480 00000100:00100000:3.0:1789117592.114515:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362468480 00000100:00100000:3.0:1789117592.114624:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 2 00000100:00100000:3.0:1789117592.114635:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28194745-e310-497c-8221-affa7d89f6fa+8:14647:x1876025362468480:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:3.0:1789117592.115822:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28194745-e310-497c-8221-affa7d89f6fa+9:14647:x1876025362468480:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 1183us (2330us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789117592.115833:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 2 00000100:00100000:2.0:1789117592.119441:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117592.119515:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362468736 00000100:00100000:3.0:1789117592.119523:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362468736 00000100:00100000:3.0:1789117592.119583:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 25 00000100:00100000:3.0:1789117592.119594:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28194745-e310-497c-8221-affa7d89f6fa+9:14647:x1876025362468736:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:3.0:1789117592.119616:0:14818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117592.119635:0:14818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f180 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cc61 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.119723:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f187 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.119738:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f187 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.119751:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f187 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.119780:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6600/0xf7565228e460f18e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.119788:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6600/0xf7565228e460f18e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.119795:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6600/0xf7565228e460f18e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117592.120130:0:14818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1789117592.120219:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f187 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.120226:0:14818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f187 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.120250:0:14818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f187 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.120256:0:14818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c7c00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117592.120259:0:14818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f187 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.120267:0:14818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f187 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.120278:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782c0e800) 00010000:00010000:3.0:1789117592.120282:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117592.120286:0:14818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f187 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.120293:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f187 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.120310:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6600/0xf7565228e460f18e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.120316:0:14818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6600/0xf7565228e460f18e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.120322:0:14818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6600/0xf7565228e460f18e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.120326:0:14818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c6600 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117592.120329:0:14818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6600/0xf7565228e460f18e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.120344:0:14818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6600/0xf7565228e460f18e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.121065:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c1782df4d00) 00010000:00010000:3.0:1789117592.121071:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117592.121077:0:14818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6600/0xf7565228e460f18e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.121085:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6600/0xf7565228e460f18e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.121137:0:14818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f180 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc61 expref: 11 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.121148:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782c0e800) 00010000:00010000:3.0:1789117592.121150:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789117592.121154:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f180 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc61 expref: 11 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.121163:0:14818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c16829c7800, rc 0) 00000100:00100000:3.0:1789117592.121228:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28194745-e310-497c-8221-affa7d89f6fa+10:14647:x1876025362468736:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 1635us (1827us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1789117592.121236:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 25 00000100:00100000:1.0:1789117592.124067:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117592.124259:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362468864 00000100:00100000:0.0:1789117592.124269:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362468864 00000100:00100000:0.0:1789117592.124333:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 26 00000100:00100000:0.0:1789117592.124343:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28194745-e310-497c-8221-affa7d89f6fa+10:14647:x1876025362468864:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:0.0:1789117592.124374:0:14817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117592.124433:0:14817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460f19c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cc68 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.124518:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f1a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.124531:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.124542:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117592.124589:0:14817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1789117592.124606:0:14817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789117592.124635:0:14817:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.124663:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460f19c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc68 expref: 12 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.124692:0:14817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc68 expref: 11 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.124699:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c1782c0ee00) 00010000:00010000:0.0:1789117592.124702:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789117592.124705:0:14817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1787cbda00, rc 0) 00000100:00100000:0.0:1789117592.124771:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28194745-e310-497c-8221-affa7d89f6fa+11:14647:x1876025362468864:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 428us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117592.124778:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 26 00000100:00100000:2.0:1789117592.129509:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117592.129622:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362468992 00000100:00100000:0.0:1789117592.129631:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362468992 00000100:00100000:0.0:1789117592.129689:0:14820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 3 00000100:00100000:0.0:1789117592.129698:0:14820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28194745-e310-497c-8221-affa7d89f6fa+11:14647:x1876025362468992:12345-192.168.206.37@tcp:37:lfs.0 00000100:00100000:0.0:1789117592.134955:0:14820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28194745-e310-497c-8221-affa7d89f6fa+11:14647:x1876025362468992:12345-192.168.206.37@tcp:37:lfs.0 Request processed in 5247us (5443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117592.134968:0:14820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 3 00000100:00100000:1.0:1789117592.139200:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117592.139276:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362469248 00000100:00100000:3.0:1789117592.139286:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362469248 00000100:00100000:3.0:1789117592.139348:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 4 00000100:00100000:3.0:1789117592.139370:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1798172450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28194745-e310-497c-8221-affa7d89f6fa+11:14647:x1876025362469248:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:3.0:1789117592.139661:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1798172450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28194745-e310-497c-8221-affa7d89f6fa+12:14647:x1876025362469248:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 292us (471us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789117592.139677:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 4 00000100:00100000:2.0:1789117592.187952:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117592.188091:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362469376 00000100:00100000:1.0:1789117592.188101:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362469376 00000100:00100000:1.0:1789117592.188160:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 27 00000100:00100000:1.0:1789117592.188171:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+10:14653:x1876025362469376:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:1.0:1789117592.188191:0:14819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117592.188217:0:14819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460f1aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cc6f expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188280:0:14819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f1b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188295:0:14819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f1b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188306:0:14819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f1b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188333:0:14819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188366:0:14819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188374:0:14819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188514:0:14819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460f1bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188524:0:14819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460f1bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188531:0:14819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460f1bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117592.188563:0:14819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1789117592.188568:0:14819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789117592.188611:0:14819:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460f1bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188624:0:14819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f1b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188631:0:14819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f1b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188638:0:14819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f1b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188644:0:14819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117592.188649:0:14819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f1b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188664:0:14819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f1b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188677:0:14819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782c0e800) 00010000:00010000:1.0:1789117592.188680:0:14819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117592.188685:0:14819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f1b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188692:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f1b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188704:0:14819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188710:0:14819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188715:0:14819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188720:0:14819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117592.188723:0:14819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188729:0:14819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188736:0:14819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c1788d9e000) 00010000:00010000:1.0:1789117592.188739:0:14819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117592.188742:0:14819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188757:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188790:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460f1aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc6f expref: 12 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188804:0:14819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ea00/0xf7565228e460f1bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc6f expref: 11 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.188811:0:14819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c1782c0ee00) 00010000:00010000:1.0:1789117592.188814:0:14819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789117592.188817:0:14819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442ea00, rc 0) 00000100:00100000:1.0:1789117592.188892:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+11:14653:x1876025362469376:12345-192.168.206.37@tcp:101:bash.0 Request processed in 722us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117592.188899:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 27 00000100:00100000:2.0:1789117592.193797:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117592.193981:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362469632 00000100:00100000:0.0:1789117592.193990:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362469632 00000100:00100000:0.0:1789117592.194088:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 28 00000100:00100000:0.0:1789117592.194100:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+11:14653:x1876025362469632:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:0.0:1789117592.194122:0:14817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117592.194154:0:14817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460f1c6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cc76 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.194370:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f1cd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.194386:0:14817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f1a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc68 expref: 11 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.194395:0:14817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f1cd lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.194461:0:14817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc68 expref: 11 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.194476:0:14817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f1a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc68 expref: 11 pid: 14817 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117592.194489:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c02552c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14817:1876025385525632:192.168.206.37@tcp:104: 00000100:00100000:0.0:1789117592.194638:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a0318780 going to sleep for 11 seconds 00010000:00010000:0.0:1789117592.197847:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117592.202219:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117592.203078:0:16933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362469760 00000100:00100000:1.0:1789117592.203090:0:16933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362469760 00010000:00010000:1.0:1789117592.203147:0:16933:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f1a3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc68 expref: 12 pid: 14817 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117592.203200:0:16933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 10 00000100:00100000:1.0:1789117592.203220:0:16933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28194745-e310-497c-8221-affa7d89f6fa+12:2350:x1876025362469760:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117592.203237:0:16933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117592.203244:0:16933:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f1a3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc68 expref: 12 pid: 14817 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.203278:0:16933:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f1a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc68 expref: 12 pid: 14817 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.203302:0:16933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c1782c0ee00) 00010000:00010000:1.0:1789117592.203308:0:16933:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f1cd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.203317:0:16933:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f1cd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.203325:0:16933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f1cd lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.203346:0:16933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117592.203449:0:16933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28194745-e310-497c-8221-affa7d89f6fa+12:2350:x1876025362469760:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 240us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117592.203458:0:16933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 10 00010000:00010000:0.0:1789117592.214034:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbda00/0xf7565228e460f1a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc68 expref: 11 pid: 14817 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117592.214062:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c02552c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14817:1876025385525632:192.168.206.37@tcp:104: 00010000:00010000:0.0:1789117592.214090:0:14817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f1cd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.214101:0:14817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f1cd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.214123:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f1cd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.214150:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f1d4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.214163:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f1d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.214174:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f1d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.219764:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045e00/0xf7565228e460f1db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.219786:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045e00/0xf7565228e460f1db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.219798:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045e00/0xf7565228e460f1db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789117592.219810:0:14817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789117592.219837:0:14817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f1cd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.219844:0:14817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f1cd lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.219851:0:14817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f1cd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.219857:0:14817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117592.219874:0:14817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f1cd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.219883:0:14817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f1cd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.219895:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c1782c0ee00) 00010000:00010000:0.0:1789117592.219898:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117592.219903:0:14817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f1cd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.219909:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd000/0xf7565228e460f1cd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789117592.219924:0:14817:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008393cec3 reply state 000000004b165df4 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f1d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117592.219934:0:14817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789117592.219968:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbca00/0xf7565228e460f1c6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc76 expref: 14 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.219983:0:14817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045e00/0xf7565228e460f1db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc76 expref: 13 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.219990:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1782c0e200) 00010000:00010000:0.0:1789117592.219992:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789117592.219995:0:14817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c17c2045e00, rc 0) 00000100:00100000:0.0:1789117592.220075:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+14:14653:x1876025362469632:12345-192.168.206.37@tcp:101:bash.0 Request processed in 25978us (26289us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789117592.220084:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 28 00010000:00010000:0.0:1789117592.227386:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f1d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.227435:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f1d4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.227443:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f1d4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.227449:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1787cbd200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117592.227454:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f1d4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.227461:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f1d4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.227477:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c1782c0e700) 00010000:00010000:0.0:1789117592.227480:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117592.227485:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f1d4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.227491:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1787cbd200/0xf7565228e460f1d4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117592.240697:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117592.241978:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362469888 00000100:00100000:1.0:1789117592.241991:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362469888 00000100:00100000:1.0:1789117592.242203:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 29 00000100:00100000:1.0:1789117592.242225:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+13:14653:x1876025362469888:12345-192.168.206.37@tcp:101:bash.0 00010000:00010000:1.0:1789117592.242250:0:14819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117592.242269:0:14819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460f1e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cc7d expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.242341:0:14819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.242382:0:14819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.242421:0:14819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117592.242458:0:14819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789117592.242463:0:14819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789117592.242480:0:14819:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.242491:0:14819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.242530:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460f1e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc7d expref: 15 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.242545:0:14819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc7d expref: 14 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.242553:0:14819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1782c0e200) 00010000:00010000:1.0:1789117592.242556:0:14819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117592.242559:0:14819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e800, rc 0) 00000100:00100000:1.0:1789117592.242622:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+14:14653:x1876025362469888:12345-192.168.206.37@tcp:101:bash.0 Request processed in 400us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117592.242629:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 29 00000100:00100000:2.0:1789117592.248493:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117592.248774:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362470144 00000100:00100000:3.0:1789117592.248783:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362470144 00000100:00100000:3.0:1789117592.248837:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 5 00000100:00100000:3.0:1789117592.248847:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+14:14653:x1876025362470144:12345-192.168.206.37@tcp:35:bash.0 00000100:00100000:3.0:1789117592.251622:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+15:14653:x1876025362470144:12345-192.168.206.37@tcp:35:bash.0 Request processed in 2767us (3127us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789117592.251635:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 5 00000100:00100000:2.0:1789117592.366698:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117592.366977:0:15529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362470400 00000100:00100000:3.0:1789117592.366988:0:15529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362470400 00000100:00100000:3.0:1789117592.367054:0:15529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 30 00000100:00100000:3.0:1789117592.367065:0:15529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+15:14664:x1876025362470400:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:3.0:1789117592.367089:0:15529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117592.367110:0:15529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f1f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cc84 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117592.367226:0:15529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1789117592.367344:0:15529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f1f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc84 expref: 17 pid: 15529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.367370:0:15529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1782c0e800) 00010000:00010000:3.0:1789117592.367372:0:15529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789117592.367378:0:15529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f1f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc84 expref: 17 pid: 15529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.367451:0:15529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c16829c7800, rc 0) 00000100:00100000:3.0:1789117592.367512:0:15529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+16:14664:x1876025362470400:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 448us (823us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1789117592.367519:0:15529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 30 00000100:00100000:0.0:1789117592.371615:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117592.371704:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362470656 00000100:00100000:3.0:1789117592.371720:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362470656 00000100:00100000:3.0:1789117592.371806:0:14820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 6 00000100:00100000:3.0:1789117592.371818:0:14820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+16:14664:x1876025362470656:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:3.0:1789117592.372181:0:14820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+17:14664:x1876025362470656:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 363us (574us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789117592.372190:0:14820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 6 00000100:00100000:2.0:1789117592.420934:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117592.421090:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362470912 00000100:00100000:3.0:1789117592.421101:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362470912 00000100:00100000:3.0:1789117592.421166:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 31 00000100:00100000:3.0:1789117592.421177:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1681ef03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+17:14667:x1876025362470912:12345-192.168.206.37@tcp:101:lfs.0 00010000:00010000:3.0:1789117592.421199:0:14818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117592.421219:0:14818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f205 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cc8b expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.421595:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6600/0xf7565228e460f20c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.421608:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6600/0xf7565228e460f20c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.421620:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6600/0xf7565228e460f20c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117592.421657:0:14818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789117592.422142:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f205 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc8b expref: 20 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.422163:0:14818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6600/0xf7565228e460f20c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc8b expref: 19 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.422172:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1782c0e200) 00010000:00010000:3.0:1789117592.422175:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789117592.422178:0:14818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c16829c6600, rc 0) 00000100:00100000:3.0:1789117592.422233:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1681ef03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+19:14667:x1876025362470912:12345-192.168.206.37@tcp:101:lfs.0 Request processed in 1058us (1307us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789117592.422242:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 31 00000100:00100000:2.0:1789117592.426865:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117592.426933:0:15529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362471040 00000100:00100000:3.0:1789117592.427007:0:15529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362471040 00000100:00100000:3.0:1789117592.427052:0:15529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 32 00000100:00100000:3.0:1789117592.427062:0:15529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+19:14667:x1876025362471040:12345-192.168.206.37@tcp:54:lfs.0 00010000:00010000:3.0:1789117592.427121:0:15529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f21a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.427137:0:15529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f21a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.427148:0:15529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f21a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.427172:0:15529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f21a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.427192:0:15529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f21a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.427198:0:15529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f21a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.427204:0:15529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c7c00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117592.427208:0:15529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f21a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.427215:0:15529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f21a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.427228:0:15529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1782c0e200) 00010000:00010000:3.0:1789117592.427231:0:15529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789117592.427237:0:15529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f21a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.427243:0:15529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f21a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117592.427503:0:15529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+19:14667:x1876025362471040:12345-192.168.206.37@tcp:54:lfs.0 Request processed in 441us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117592.427512:0:15529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 32 00000100:00100000:0.0:1789117592.433078:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117592.433175:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117592.433266:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362471424 00000100:00100000:1.0:1789117592.433274:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362471424 00000100:00100000:1.0:1789117592.433361:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 0 00000100:00100000:1.0:1789117592.433387:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0254b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+19:2350:x1876025362471424:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117592.433422:0:14802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117592.433446:0:14802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6600/0xf7565228e460f20c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc8b expref: 19 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.433464:0:14802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1782c0e200) 00010000:00010000:1.0:1789117592.433469:0:14802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117592.433530:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0254b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+18:2350:x1876025362471424:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 146us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117592.433538:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 0 00000100:00100000:3.0:1789117592.435238:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362471296 00000100:00100000:3.0:1789117592.435250:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362471296 00000100:00100000:3.0:1789117592.435503:0:14820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 7 00000100:00100000:3.0:1789117592.435514:0:14820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0257840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+18:14667:x1876025362471296:12345-192.168.206.37@tcp:35:lfs.0 00000100:00100000:3.0:1789117592.435733:0:14820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0257840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+19:14667:x1876025362471296:12345-192.168.206.37@tcp:35:lfs.0 Request processed in 220us (3078us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789117592.435752:0:14820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 7 00000040:00080000:3.0:1789117592.646280:0:14852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789117592.714729:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117592.715024:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362471680 00000100:00100000:1.0:1789117592.715033:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362471680 00000100:00100000:1.0:1789117592.715098:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 33 00000100:00100000:1.0:1789117592.715108:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+19:14698:x1876025362471680:12345-192.168.206.37@tcp:101:cat.0 00010000:00010000:1.0:1789117592.715132:0:14819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117592.715153:0:14819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460f221 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cc92 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.715243:0:14819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f228 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.715256:0:14819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f228 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.715267:0:14819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f228 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789117592.715280:0:14819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789117592.715496:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460f221 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc92 expref: 22 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.715514:0:14819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f228 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc92 expref: 21 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.715523:0:14819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1782c0e200) 00010000:00010000:1.0:1789117592.715525:0:14819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789117592.715529:0:14819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e200, rc 0) 00000100:00100000:1.0:1789117592.715584:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+21:14698:x1876025362471680:12345-192.168.206.37@tcp:101:cat.0 Request processed in 477us (864us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1789117592.715591:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 33 00000100:00100000:2.0:1789117592.722950:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117592.722995:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117592.723126:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362471936 00000100:00100000:0.0:1789117592.723137:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362471936 00000100:00100000:0.0:1789117592.723194:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 8 00000100:00100000:0.0:1789117592.723205:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+21:14698:x1876025362471936:12345-192.168.206.37@tcp:35:cat.0 00000100:00100000:0.0:1789117592.723594:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+22:14698:x1876025362471936:12345-192.168.206.37@tcp:35:cat.0 Request processed in 390us (652us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1789117592.723601:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 8 00000100:00100000:1.0:1789117592.725169:0:16933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362472064 00000100:00100000:1.0:1789117592.725180:0:16933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362472064 00000100:00100000:1.0:1789117592.725244:0:16933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 1 00000100:00100000:1.0:1789117592.725254:0:16933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+22:2352:x1876025362472064:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117592.725268:0:16933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117592.725291:0:16933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f228 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc92 expref: 22 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.725585:0:16933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1782c0e200) 00010000:00010000:1.0:1789117592.725590:0:16933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117592.725701:0:16933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+21:2352:x1876025362472064:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 447us (2704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117592.725708:0:16933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 1 00000100:00100000:2.0:1789117592.797453:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117592.797599:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362472320 00000100:00100000:0.0:1789117592.797610:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362472320 00000100:00100000:0.0:1789117592.797671:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 34 00000100:00100000:0.0:1789117592.797690:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+21:14704:x1876025362472320:12345-192.168.206.37@tcp:101:dd.0 00010000:00010000:0.0:1789117592.797713:0:14817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117592.797731:0:14817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460f236 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cc99 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.797834:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460f23d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.797849:0:14817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045e00/0xf7565228e460f1db lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc76 expref: 22 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.797858:0:14817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1f0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc7d expref: 22 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.798026:0:14817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460f23d lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.798062:0:14817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc7d expref: 22 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.798076:0:14817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc7d expref: 22 pid: 14819 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117592.798110:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c0256d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14817:1876025385525760:192.168.206.37@tcp:104: 00010000:00010000:0.0:1789117592.798214:0:14817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045e00/0xf7565228e460f1db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc76 expref: 22 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117592.798223:0:14817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045e00/0xf7565228e460f1db lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc76 expref: 22 pid: 14817 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117592.798233:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c087b840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14817:1876025385525888:192.168.206.37@tcp:104: 00000100:00100000:0.0:1789117592.798256:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a0318780 going to sleep for 11 seconds 00000100:00100000:0.0:1789117592.801521:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117592.801547:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117592.801774:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c0256d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14817:1876025385525760:192.168.206.37@tcp:104: 00000100:00100000:3.0:1789117592.801788:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c087b840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14817:1876025385525888:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117592.801813:0:14817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460f23d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117592.802002:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362472448 00000100:00100000:2.0:1789117592.802010:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362472448 00010000:00010000:2.0:1789117592.802045:0:14804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc7d expref: 23 pid: 14819 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117592.802116:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362472576 00000100:00100000:2.0:1789117592.802120:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362472576 00010000:00010000:2.0:1789117592.802134:0:14804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045e00/0xf7565228e460f1db lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc76 expref: 24 pid: 14817 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117592.802185:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 11 00000100:00100000:2.0:1789117592.802195:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1787267c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+24:2350:x1876025362472448:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117592.802210:0:14804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117592.802217:0:14804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc7d expref: 24 pid: 14819 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117592.802229:0:14804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc7d expref: 24 pid: 14819 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117592.802249:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e800/0xf7565228e460f1f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc7d expref: 24 pid: 14819 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117592.802265:0:14804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1782c0e200) 00010000:00010000:2.0:1789117592.802270:0:14804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460f23d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117592.802278:0:14804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460f23d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117592.802285:0:14804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117592.802345:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1787267c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+23:2350:x1876025362472448:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 152us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117592.802363:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 11 00000100:00100000:2.0:1789117592.802445:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 12 00000100:00100000:2.0:1789117592.802453:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c087bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+22:2351:x1876025362472576:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117592.802470:0:14804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117592.802476:0:14804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045e00/0xf7565228e460f1db lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc76 expref: 22 pid: 14817 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117592.802487:0:14804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045e00/0xf7565228e460f1db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc76 expref: 22 pid: 14817 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117592.802499:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045e00/0xf7565228e460f1db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc76 expref: 22 pid: 14817 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117592.802510:0:14804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1782c0e200) 00010000:00010000:2.0:1789117592.802514:0:14804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460f23d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117592.802521:0:14804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460f23d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117592.802527:0:14804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460f23d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117592.802545:0:14804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117592.802565:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c087bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+21:2351:x1876025362472576:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 112us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117592.802571:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 12 00010000:00010000:3.0:1789117592.804092:0:14817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460f23d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.804106:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460f23d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117592.804127:0:14817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789117592.804293:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460f236 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc99 expref: 22 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.804379:0:14817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2044200/0xf7565228e460f23d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cc99 expref: 21 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.804388:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1782c0e200) 00010000:00010000:3.0:1789117592.804391:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789117592.804394:0:14817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c17c2044200, rc 0) 00000100:00100000:2.0:1789117592.804676:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+21:14704:x1876025362472320:12345-192.168.206.37@tcp:101:dd.0 Request processed in 6986us (7230us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789117592.804684:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 34 00000100:00100000:0.0:1789117592.807936:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117592.808034:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362472832 00000100:00100000:1.0:1789117592.808044:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362472832 00000100:00100000:1.0:1789117592.808112:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 35 00000100:00100000:1.0:1789117592.808122:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0878f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+21:14704:x1876025362472832:12345-192.168.206.37@tcp:36:dd.0 00010000:00010000:1.0:1789117592.808652:0:14819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f24b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.808737:0:14819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f24b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.808750:0:14819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f24b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789117592.808955:0:14819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1789117592.808993:0:14819:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c74fa438 reply state 00000000cac5714f transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f24b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117592.809002:0:14819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789117592.809127:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0878f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+24:14704:x1876025362472832:12345-192.168.206.37@tcp:36:dd.0 Request processed in 1004us (1265us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1789117592.809136:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 35 00000020:00080000:1.0:1789117592.809141:0:14819:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789117592.811462:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f24b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.811477:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f24b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.811484:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f24b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.811490:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442e200 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117592.811495:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f24b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.811516:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f24b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.811531:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1782c0e200) 00010000:00010000:1.0:1789117592.811534:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117592.811539:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f24b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117592.811546:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f24b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117592.812515:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117592.813252:0:15529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362472960 00000100:00100000:3.0:1789117592.813261:0:15529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362472960 00000100:00100000:3.0:1789117592.813448:0:15529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 36 00000100:00100000:3.0:1789117592.813459:0:15529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0878780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+23:14704:x1876025362472960:12345-192.168.206.37@tcp:101:dd.0 00010000:00010000:3.0:1789117592.813496:0:15529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117592.813515:0:15529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f252 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cca0 expref: -99 pid: 15529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.813572:0:15529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f252 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cca0 expref: 24 pid: 15529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.813586:0:15529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f252 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cca0 expref: 24 pid: 15529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.813604:0:15529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1782c0e200) 00010000:00010000:3.0:1789117592.813607:0:15529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789117592.813611:0:15529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c16829c7c00, rc 0) 00000100:00100000:3.0:1789117592.821177:0:15529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0878780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+24:14704:x1876025362472960:12345-192.168.206.37@tcp:101:dd.0 Request processed in 208us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117592.821193:0:15529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 36 00000100:00100000:0.0:1789117592.828501:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117592.828657:0:14804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362473216 00000100:00100000:2.0:1789117592.828688:0:14804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362473216 00000100:00100000:2.0:1789117592.828806:0:14804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 2 00000100:00100000:2.0:1789117592.828817:0:14804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0879e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+24:14704:x1876025362473216:12345-192.168.206.37@tcp:103:dd.0 00010000:00010000:2.0:1789117592.828834:0:14804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117592.828857:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f252 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cca0 expref: 24 pid: 15529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117592.828886:0:14804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1782c0e200) 00010000:00010000:2.0:1789117592.828892:0:14804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117592.828949:0:14804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0879e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+23:14704:x1876025362473216:12345-192.168.206.37@tcp:103:dd.0 Request processed in 134us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117592.828958:0:14804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 2 00000100:00100000:0.0:1789117592.830809:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117592.830904:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362473344 00000100:00100000:3.0:1789117592.830913:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362473344 00000100:00100000:3.0:1789117592.830970:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 37 00000100:00100000:3.0:1789117592.830980:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c08792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+23:14704:x1876025362473344:12345-192.168.206.37@tcp:58:dd.0 00010000:00010000:3.0:1789117592.831066:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f259 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.831082:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f259 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.831094:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f259 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789117592.831926:0:14818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789117592.832103:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1789117592.832173:0:14818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1789117592.832287:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c08792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+23:14704:x1876025362473344:12345-192.168.206.37@tcp:58:dd.0 Request processed in 1304us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117592.832297:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 37 00000100:00100000:0.0:1789117592.835334:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117592.835475:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362473472 00000100:00100000:3.0:1789117592.835485:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362473472 00000100:00100000:3.0:1789117592.835541:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 38 00000100:00100000:3.0:1789117592.835551:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c087a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+23:14704:x1876025362473472:12345-192.168.206.37@tcp:101:dd.0 00010000:00010000:3.0:1789117592.835570:0:14817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117592.835589:0:14817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7000/0xf7565228e460f260 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9cca7 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.835643:0:14817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f259 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.835653:0:14817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7000/0xf7565228e460f260 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cca7 expref: 24 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.835684:0:14817:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f259 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.835697:0:14817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7000/0xf7565228e460f260 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cca7 expref: 24 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.835710:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1782c0e200) 00010000:00010000:3.0:1789117592.835724:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789117592.835729:0:14817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7000/0xf7565228e460f260 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cca7 expref: 24 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117592.835736:0:14817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c16829c7000, rc 0) 00000100:00100000:3.0:1789117592.835803:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c087a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+24:14704:x1876025362473472:12345-192.168.206.37@tcp:101:dd.0 Request processed in 253us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117592.835810:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 38 00010000:00010000:0.0:1789117593.221651:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789117593.669862:0:14852:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789117593.669870:0:14852:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789117593.669899:0:14852:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789117593.669904:0:14852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789117593.670011:0:14852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c178be712c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14852:1876025385526016:192.168.206.37@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789117593.670110:0:14852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c178720e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789117593.682930:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117593.683835:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362473600 00000100:00100000:1.0:1789117593.683845:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362473600 00000100:00100000:1.0:1789117593.683918:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 0 00000100:00100000:1.0:1789117593.683930:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c087a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+25:14705:x1876025362473600:12345-192.168.206.37@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789117593.684019:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c087a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+25:14705:x1876025362473600:12345-192.168.206.37@tcp:900:lhsmtool_posix.0 Request processed in 92us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117593.684028:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 0 00000100:00080000:0.0:1789117593.685270:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117593.686108:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117593.686188:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362473728 00000100:00100000:3.0:1789117593.686196:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362473728 00000100:00100000:3.0:1789117593.686252:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 39 00000100:00100000:3.0:1789117593.686262:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c087b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+25:14705:x1876025362473728:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789117593.686290:0:14818:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789117593.686434:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c087b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+25:14705:x1876025362473728:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 Request processed in 172us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117593.686441:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 39 00000100:00100000:2.0:1789117593.689046:0:14852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c178be712c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14852:1876025385526016:192.168.206.37@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789117593.696904:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117593.697370:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362473856 00000100:00100000:3.0:1789117593.697381:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362473856 00000100:00100000:3.0:1789117593.697514:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 40 00000100:00100000:3.0:1789117593.697525:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+24:14705:x1876025362473856:12345-192.168.206.37@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789117593.697603:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6c00/0xf7565228e460f267 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.697632:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6c00/0xf7565228e460f267 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.697644:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6c00/0xf7565228e460f267 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.697837:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6400/0xf7565228e460f26e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.697846:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6400/0xf7565228e460f26e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.697853:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6400/0xf7565228e460f26e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.697877:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f275 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.697885:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f275 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.698002:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f275 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117593.698042:0:14817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789117593.698046:0:14817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789117593.698057:0:14817:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f275 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.698068:0:14817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6c00/0xf7565228e460f267 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.698083:0:14817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6c00/0xf7565228e460f267 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.698090:0:14817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6c00/0xf7565228e460f267 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.698096:0:14817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c6c00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117593.698100:0:14817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6c00/0xf7565228e460f267 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.698107:0:14817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6c00/0xf7565228e460f267 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.698118:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1788d9e600) 00010000:00010000:3.0:1789117593.698120:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117593.698125:0:14817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6c00/0xf7565228e460f267 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.698694:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6c00/0xf7565228e460f267 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.698715:0:14817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6400/0xf7565228e460f26e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.698722:0:14817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6400/0xf7565228e460f26e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.698728:0:14817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6400/0xf7565228e460f26e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.698734:0:14817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c6400 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117593.698745:0:14817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6400/0xf7565228e460f26e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.698752:0:14817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6400/0xf7565228e460f26e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.698763:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9c1782df4d00) 00010000:00010000:3.0:1789117593.698766:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117593.698769:0:14817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6400/0xf7565228e460f26e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.698775:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6400/0xf7565228e460f26e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.698790:0:14817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f275 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.698796:0:14817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f275 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.698801:0:14817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f275 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.698818:0:14817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c7c00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117593.698822:0:14817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f275 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.698829:0:14817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f275 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.699147:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1782c0e200) 00010000:00010000:3.0:1789117593.699150:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789117593.699161:0:14817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f275 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.699167:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7c00/0xf7565228e460f275 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117593.699441:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+24:14705:x1876025362473856:12345-192.168.206.37@tcp:34:lhsmtool_posix.0 Request processed in 1913us (2548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117593.699452:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 40 00000100:00100000:1.0:1789117593.701841:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117593.701922:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362474112 00000100:00100000:3.0:1789117593.701932:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362474112 00000100:00100000:3.0:1789117593.701992:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 41 00000100:00100000:3.0:1789117593.702002:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+24:14705:x1876025362474112:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789117593.702021:0:14818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117593.702039:0:14818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6600/0xf7565228e460f27c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ccae expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.702126:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f283 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.702140:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.702151:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789117593.702161:0:14818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789117593.702251:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.702259:0:14818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f283 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.702266:0:14818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f283 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.702289:0:14818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c7a00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:3.0:1789117593.702294:0:14818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f283 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.702301:0:14818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f283 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.702313:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1782c0e200) 00010000:00010000:3.0:1789117593.702316:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789117593.702321:0:14818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f283 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.702327:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7a00/0xf7565228e460f283 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.702383:0:14818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6600/0xf7565228e460f27c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccae expref: 26 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.702394:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1788d9e600) 00010000:00010000:3.0:1789117593.702396:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789117593.702432:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6600/0xf7565228e460f27c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccae expref: 26 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.702443:0:14818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c16829c6600, rc 0) 00000100:00100000:3.0:1789117593.702489:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+25:14705:x1876025362474112:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 488us (655us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1789117593.702496:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 41 00000100:00100000:0.0:1789117593.705931:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117593.706084:0:15529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362474240 00000100:00100000:1.0:1789117593.706094:0:15529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362474240 00000100:00100000:1.0:1789117593.706146:0:15529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 42 00000100:00100000:1.0:1789117593.706155:0:15529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+25:14705:x1876025362474240:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789117593.706188:0:15529:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789117593.706277:0:15529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+25:14705:x1876025362474240:12345-192.168.206.37@tcp:53:lhsmtool_posix.0 Request processed in 123us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117593.706296:0:15529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 42 00000100:00100000:1.0:1789117593.712101:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117593.712679:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362474496 00000100:00100000:3.0:1789117593.712880:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362474496 00000100:00100000:3.0:1789117593.712932:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 43 00000100:00100000:3.0:1789117593.712942:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+25:14705:x1876025362474496:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789117593.712961:0:14818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789117593.712981:0:14818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6600/0xf7565228e460f291 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ccb5 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789117593.714875:0:14818:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:2.0:1789117593.714886:0:14818:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1789117593.714964:0:14818:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1789117593.715275:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460f298 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.715290:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460f298 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.715301:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460f298 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.715390:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c6600/0xf7565228e460f291 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccb5 expref: 28 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.715451:0:14818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460f298 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccb5 expref: 27 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.715459:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1783e89e00) 00010000:00010000:2.0:1789117593.715462:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789117593.715466:0:14818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f600, rc 0) 00000100:00100000:2.0:1789117593.715531:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+27:14705:x1876025362474496:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 2590us (3444us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1789117593.715540:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 43 00000100:00100000:0.0:1789117593.721983:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117593.723585:0:15529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362474752 00000100:00100000:1.0:1789117593.723597:0:15529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362474752 00000100:00100000:1.0:1789117593.724010:0:15529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 44 00000100:00100000:1.0:1789117593.724022:0:15529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0878b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+27:14705:x1876025362474752:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789117593.724077:0:15529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117593.724105:0:15529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f600/0xf7565228e460f298 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccb5 expref: 27 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.724122:0:15529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1783e89e00) 00010000:00010000:1.0:1789117593.724134:0:15529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789117593.724157:0:15529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460f2a6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.724170:0:15529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460f2a6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.724179:0:15529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460f2a6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.724192:0:15529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460f2ad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xedbd18ad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.724199:0:15529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460f2ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xedbd18ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.724205:0:15529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460f2ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xedbd18ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.724289:0:15529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460f2a6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.724309:0:15529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460f2a6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.724316:0:15529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460f2a6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.724321:0:15529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442f000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117593.724325:0:15529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460f2a6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.724331:0:15529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460f2a6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.724340:0:15529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c1782c0ee00) 00010000:00010000:1.0:1789117593.724354:0:15529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117593.724358:0:15529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460f2a6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.724365:0:15529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f000/0xf7565228e460f2a6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.724374:0:15529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460f2ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xedbd18ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.724380:0:15529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460f2ad lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xedbd18ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.724386:0:15529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460f2ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xedbd18ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.724427:0:15529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442f400 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117593.724431:0:15529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460f2ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xedbd18ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.724438:0:15529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460f2ad lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xedbd18ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.724447:0:15529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xedbd18ad (ffff9c1788d9e000) 00010000:00010000:1.0:1789117593.724449:0:15529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117593.724452:0:15529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460f2ad lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xedbd18ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.724458:0:15529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460f2ad lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xedbd18ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117593.724549:0:15529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0878b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+26:14705:x1876025362474752:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 Request processed in 529us (2575us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789117593.724556:0:15529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 44 00000100:00100000:0.0:1789117593.727273:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117593.727691:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362474880 00000100:00100000:1.0:1789117593.727702:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362474880 00000100:00100000:1.0:1789117593.727846:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 45 00000100:00100000:1.0:1789117593.727857:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c08783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+26:14705:x1876025362474880:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789117593.727876:0:14819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117593.727896:0:14819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460f2b4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ccbc expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.727931:0:14819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f2bb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.727962:0:14819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f2bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.727973:0:14819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f2bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.728067:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442ee00/0xf7565228e460f2b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccbc expref: 28 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.728084:0:14819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442e200/0xf7565228e460f2bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccbc expref: 27 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.728092:0:14819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1788d9ed00) 00010000:00010000:1.0:1789117593.728095:0:14819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789117593.728099:0:14819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442e200, rc 0) 00000100:00100000:1.0:1789117593.728159:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c08783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+27:14705:x1876025362474880:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 304us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117593.728166:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 45 00000100:00100000:3.0:1789117593.731768:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117593.732782:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362475136 00000100:00100000:2.0:1789117593.732794:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362475136 00000100:00100000:2.0:1789117593.732857:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 46 00000100:00100000:2.0:1789117593.732867:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+27:14705:x1876025362475136:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789117593.732936:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fc00/0xf7565228e460f2c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.732951:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fc00/0xf7565228e460f2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.732961:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fc00/0xf7565228e460f2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789117593.733355:0:14817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1789117593.733367:0:14817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440862966384ns, next at 441862963523ns, rc = 0 00000004:00010000:2.0:1789117593.733475:0:14817:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000063671e88 reply state 0000000057277049 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fc00/0xf7565228e460f2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117593.733485:0:14817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789117593.734985:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+29:14705:x1876025362475136:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 Request processed in 2110us (3217us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1789117593.734995:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 46 00000100:00100000:0.0:1789117593.739102:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117593.739397:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362475264 00000100:00100000:1.0:1789117593.739434:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362475264 00000100:00100000:1.0:1789117593.739480:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 47 00000100:00100000:1.0:1789117593.739490:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0879a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+29:14705:x1876025362475264:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789117593.739511:0:14818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789117593.739530:0:14818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460f2c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ccc3 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.739584:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460f2c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccc3 expref: 30 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.739610:0:14818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460f2c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccc3 expref: 30 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.739629:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1788d9ed00) 00010000:00010000:1.0:1789117593.739632:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789117593.739636:0:14818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178442f400, rc 0) 00000100:00100000:1.0:1789117593.739701:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0879a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+30:14705:x1876025362475264:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 212us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117593.739709:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 47 00010000:00010000:2.0:1789117593.739998:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fc00/0xf7565228e460f2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.740007:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fc00/0xf7565228e460f2c2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.740014:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fc00/0xf7565228e460f2c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.740020:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457fc00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117593.740024:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fc00/0xf7565228e460f2c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.740032:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fc00/0xf7565228e460f2c2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.740043:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1788d9ed00) 00010000:00010000:2.0:1789117593.740046:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789117593.740050:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fc00/0xf7565228e460f2c2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.740056:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fc00/0xf7565228e460f2c2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117593.743335:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117593.743463:0:15501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362475392 00000100:00100000:1.0:1789117593.743472:0:15501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362475392 00000100:00100000:1.0:1789117593.743540:0:15501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 12 00000100:00100000:1.0:1789117593.743550:0:15501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c087b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+5:2351:x1876025362475392:12345-192.168.206.37@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789117593.743960:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789117593.743997:0:15501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c087b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+6:2351:x1876025362475392:12345-192.168.206.37@tcp:2:lhsmtool_posix.0 Request processed in 446us (669us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789117593.744005:0:15501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 12 00000100:00100000:3.0:1789117593.746632:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117593.746709:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362475648 00000100:00100000:0.0:1789117593.746718:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362475648 00000100:00100000:0.0:1789117593.746785:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 9 00000100:00100000:0.0:1789117593.746795:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+29:14705:x1876025362475648:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789117593.747467:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+30:14705:x1876025362475648:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 Request processed in 669us (838us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1789117593.747476:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 9 00000100:00100000:3.0:1789117593.749275:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117593.749610:0:15529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362475904 00000100:00100000:0.0:1789117593.749618:0:15529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362475904 00000100:00100000:0.0:1789117593.749777:0:15529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 48 00000100:00100000:0.0:1789117593.749788:0:15529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+30:14705:x1876025362475904:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789117593.749891:0:15529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+30:14705:x1876025362475904:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 Request processed in 98us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117593.749898:0:15529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 48 00000100:00100000:3.0:1789117593.752438:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117593.753115:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362476032 00000100:00100000:2.0:1789117593.753136:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362476032 00000100:00100000:2.0:1789117593.753227:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 49 00000100:00100000:2.0:1789117593.753237:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+30:14705:x1876025362476032:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789117593.753255:0:14817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789117593.753273:0:14817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fc00/0xf7565228e460f2d0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ccca expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.753370:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f000/0xf7565228e460f2d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.753385:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f000/0xf7565228e460f2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.753396:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f000/0xf7565228e460f2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789117593.753449:0:14817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789117593.753466:0:14817:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f000/0xf7565228e460f2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.753491:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457fc00/0xf7565228e460f2d0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccca expref: 32 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.753508:0:14817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f000/0xf7565228e460f2d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccca expref: 31 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.753516:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1788d9ed00) 00010000:00010000:2.0:1789117593.753519:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789117593.753522:0:14817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c178457f000, rc 0) 00000100:00100000:2.0:1789117593.753570:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+31:14705:x1876025362476032:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 334us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117593.753583:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 49 00000100:00100000:3.0:1789117593.757194:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117593.757450:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362476160 00000100:00100000:0.0:1789117593.757459:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362476160 00000100:00100000:0.0:1789117593.757622:0:15504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 13 00000100:00100000:0.0:1789117593.757633:0:15504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+6:2350:x1876025362476160:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789117593.757651:0:15504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789117593.757682:0:15504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ceb9cf7e/0xf7565228e460f2de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ce901a66dd9ccd1 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789117593.757709:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3c498, blocks: 0x1 00010000:00010000:0.0:1789117593.757728:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1789117593.757732:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117593.757753:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ceb9cf7e/0xf7565228e460f2de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccd1 expref: 7 pid: 15504 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.757774:0:15504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ceb9cf7e/0xf7565228e460f2de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccd1 expref: 7 pid: 15504 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.757787:0:15504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c17c2044c00, rc 0) 00000100:00100000:0.0:1789117593.757849:0:15504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+7:2350:x1876025362476160:12345-192.168.206.37@tcp:101:lhsmtool_posix.0 Request processed in 218us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117593.757857:0:15504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 13 00000100:00100000:2.0:1789117593.761216:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117593.761549:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362476416 00000100:00100000:3.0:1789117593.761558:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362476416 00000100:00100000:2.0:1789117593.761757:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 50 00000100:00100000:2.0:1789117593.761768:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+31:14705:x1876025362476416:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789117593.761868:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+31:14705:x1876025362476416:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 Request processed in 102us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117593.761876:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 50 00000100:00100000:3.0:1789117593.764047:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117593.764575:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362476544 00000100:00100000:0.0:1789117593.764584:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362476544 00000100:00100000:1.0:1789117593.765068:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 51 00000100:00100000:1.0:1789117593.765080:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+31:14705:x1876025362476544:12345-192.168.206.37@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789117593.806849:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:2.0:1789117593.806897:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000004:00080000:2.0:1789117593.806914:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1789117593.807048:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385526144:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789117593.807113:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117593.807190:0:15501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385526144 00000100:00100000:2.0:1789117593.807197:0:15501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385526144 00000100:00100000:2.0:1789117593.807261:0:15501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789117593.807270:0:15501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876025385526144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789117593.807451:0:15501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789117593.807455:0:15501:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789117593.807457:0:15501:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789117593.807459:0:15501:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789117592 -> 1789117592 00002000:00010000:2.0:1789117593.807462:0:15501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789117593.807502:0:15501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876025385526144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 232us (388us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789117593.807509:0:15501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789117593.807545:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789117593.807588:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c17b87a3c00/2, rc 0, transno 8589934595 00000100:00100000:2.0:1789117593.807594:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876025385526144:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1789117593.807635:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1789117593.808209:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+14:14705:x1876025362476544:12345-192.168.206.37@tcp:44:lhsmtool_posix.0 Request processed in 43119us (44156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117593.808218:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 51 00000100:00100000:3.0:1789117593.812669:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117593.813022:0:16226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362476672 00000100:00100000:1.0:1789117593.813031:0:16226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362476672 00000100:00100000:1.0:1789117593.813091:0:16226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 15 00000100:00100000:1.0:1789117593.813102:0:16226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c178be712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+7:2350:x1876025362476672:12345-192.168.206.37@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789117593.813211:0:16226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c178be712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+7:2350:x1876025362476672:12345-192.168.206.37@tcp:16:lhsmtool_posix.0 Request processed in 110us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117593.813233:0:16226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 15 00000100:00100000:2.0:1789117593.815503:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117593.815595:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362476928 00000100:00100000:0.0:1789117593.815604:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362476928 00000100:00100000:0.0:1789117593.815771:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 52 00000100:00100000:0.0:1789117593.815782:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+14:14705:x1876025362476928:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789117593.815834:0:14819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117593.815859:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457f000/0xf7565228e460f2d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccca expref: 14 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.815876:0:14819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1788d9ed00) 00010000:00010000:0.0:1789117593.815881:0:14819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789117593.815921:0:14819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045a00/0xf7565228e460f2e5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.815935:0:14819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045a00/0xf7565228e460f2e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.815962:0:14819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045a00/0xf7565228e460f2e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789117593.816137:0:14819:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000130c0445 reply state 000000009b3e3c62 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045a00/0xf7565228e460f2e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117593.816146:0:14819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789117593.816286:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07947d2f-ef96-4aa5-be78-0cb12cc06f21+15:14705:x1876025362476928:12345-192.168.206.37@tcp:36:lhsmtool_posix.0 Request processed in 504us (789us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789117593.816294:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 52 00000100:00100000:2.0:1789117593.819517:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117593.819650:0:15501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362477056 00000100:00100000:3.0:1789117593.819664:0:15501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362477056 00000100:00100000:3.0:1789117593.819717:0:15501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 16 00000100:00100000:3.0:1789117593.819727:0:15501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+7:2349:x1876025362477056:12345-192.168.206.37@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789117593.819915:0:15501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789117593.819919:0:15501:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789117591 00002000:00010000:3.0:1789117593.819921:0:15501:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789117591 00002000:00010000:3.0:1789117593.819923:0:15501:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789117592 -> 1789117591 00002000:00010000:3.0:1789117593.819939:0:15501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789117593.819995:0:15501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+8:2349:x1876025362477056:12345-192.168.206.37@tcp:2:lhsmtool_posix.0 Request processed in 269us (487us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789117593.820004:0:15501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 16 00010000:00010000:1.0:1789117593.821228:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045a00/0xf7565228e460f2e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.821243:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045a00/0xf7565228e460f2e5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.821251:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045a00/0xf7565228e460f2e5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.821258:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2045a00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:1.0:1789117593.821263:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045a00/0xf7565228e460f2e5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.821271:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045a00/0xf7565228e460f2e5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.821287:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1788d9ed00) 00010000:00010000:1.0:1789117593.821290:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117593.821303:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045a00/0xf7565228e460f2e5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.821310:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045a00/0xf7565228e460f2e5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117593.823566:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117593.823665:0:16226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362477184 00000100:00100000:1.0:1789117593.823675:0:16226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362477184 00000100:00100000:1.0:1789117593.823733:0:16226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 17 00000100:00100000:1.0:1789117593.823744:0:16226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0254b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+8:2350:x1876025362477184:12345-192.168.206.37@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789117593.823787:0:16226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c6d668fa/0xf7565228e460f2ec lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.823815:0:16226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117593.823819:0:16226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117593.823826:0:16226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6d668fa/0xf7565228e460f2ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.823840:0:16226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6d668fa/0xf7565228e460f2ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.823869:0:16226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c6d668fa/0xf7565228e460f2ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.823878:0:16226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6d668fa/0xf7565228e460f2ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.823887:0:16226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6d668fa/0xf7565228e460f2ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.823908:0:16226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442f000 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:1.0:1789117593.823912:0:16226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6d668fa/0xf7565228e460f2ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.823921:0:16226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6d668fa/0xf7565228e460f2ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.823936:0:16226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6d668fa/0xf7565228e460f2ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.823951:0:16226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6d668fa/0xf7565228e460f2ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117593.824027:0:16226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0254b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+8:2350:x1876025362477184:12345-192.168.206.37@tcp:1:lhsmtool_posix.0 Request processed in 285us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117593.824034:0:16226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 17 00000100:00100000:0.0:1789117593.827522:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117593.827731:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362477440 00000100:00100000:2.0:1789117593.827740:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362477440 00000100:00100000:2.0:1789117593.827785:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 53 00000100:00100000:2.0:1789117593.827794:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c087a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+14:14705:x1876025362477440:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789117593.827868:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460f2f3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.827886:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460f2f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.828176:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460f2f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.828559:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460f2fa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.828571:0:14818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460f2c9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccc3 expref: 15 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.828579:0:14818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460f2fa lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.828608:0:14818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460f2c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccc3 expref: 15 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.828632:0:14818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460f2c9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccc3 expref: 15 pid: 14818 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117593.828645:0:14818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14818:1876025385526272:192.168.206.37@tcp:104: 00000100:00100000:2.0:1789117593.828740:0:14818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17870ec780 going to sleep for 11 seconds 00000100:00100000:2.0:1789117593.833880:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117593.833963:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362477568 00000100:00100000:3.0:1789117593.833971:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362477568 00010000:00010000:3.0:1789117593.834009:0:14803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460f2c9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccc3 expref: 16 pid: 14818 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117593.834050:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 13 00000100:00100000:3.0:1789117593.834060:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+16:2349:x1876025362477568:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789117593.834073:0:14803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789117593.834079:0:14803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460f2c9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccc3 expref: 16 pid: 14818 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.834091:0:14803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460f2c9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccc3 expref: 16 pid: 14818 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.834112:0:14803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1788d9ed00) 00010000:00010000:3.0:1789117593.834118:0:14803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460f2fa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.834127:0:14803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460f2fa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.834134:0:14803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460f2fa lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117593.834169:0:14803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789117593.834231:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+16:2349:x1876025362477568:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 168us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117593.834241:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 13 00010000:00010000:1.0:1789117593.837017:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178442f400/0xf7565228e460f2c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccc3 expref: 15 pid: 14818 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117593.837043:0:14818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14818:1876025385526272:192.168.206.37@tcp:104: 00010000:00010000:1.0:1789117593.837067:0:14818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460f2fa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.837077:0:14818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460f2fa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117593.837082:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460f2fa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789117593.837264:0:14818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789117593.837958:0:14818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789117593.838007:0:14818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789117593.838089:0:14818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87a21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14818:1876025385526400:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789117593.838198:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117593.838287:0:14818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17870ec840 going to sleep for 11 seconds 00000100:00100000:0.0:1789117593.838945:0:14822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385526400 00000100:00100000:0.0:1789117593.838955:0:14822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385526400 00000100:00100000:0.0:1789117593.839038:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789117593.839048:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14818:x1876025385526400:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789117593.839144:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14818:x1876025385526400:12345-0@lo:1000:mdt00_001.0 Request processed in 97us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117593.839151:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789117593.839214:0:14818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87a21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14818:1876025385526400:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789117593.839882:0:14818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1789117593.839945:0:14818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87a21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14818:1876025385526528:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789117593.839986:0:14818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117593.840665:0:14823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385526528 00000100:00100000:1.0:1789117593.840674:0:14823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385526528 00000100:00100000:2.0:1789117593.840684:0:14818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17870ec540 going to sleep for 11 seconds 00000100:00100000:1.0:1789117593.840709:0:14823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789117593.840717:0:14823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14818:x1876025385526528:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789117593.840925:0:14823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14818:x1876025385526528:12345-0@lo:1000:mdt00_001.0 Request processed in 208us (938us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789117593.840943:0:14823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789117593.841000:0:14818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87a21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14818:1876025385526528:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789117593.841032:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460f2fa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.841039:0:14818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460f2fa lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.841045:0:14818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460f2fa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.841060:0:14818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117593.841064:0:14818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460f2fa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.841072:0:14818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460f2fa lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.841085:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1788d9ed00) 00010000:00010000:2.0:1789117593.841088:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789117593.841092:0:14818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460f2fa lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.841098:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457e800/0xf7565228e460f2fa lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.841126:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f259 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.841132:0:14818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f259 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.841137:0:14818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f259 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.841142:0:14818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c7800 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:2.0:1789117593.841145:0:14818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f259 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.841151:0:14818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f259 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.841170:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1782c0e200) 00010000:00010000:2.0:1789117593.841172:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789117593.841178:0:14818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7000/0xf7565228e460f260 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cca7 expref: 18 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.841190:0:14818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7000/0xf7565228e460f260 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cca7 expref: 18 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.841199:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7000/0xf7565228e460f260 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cca7 expref: 18 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.841251:0:14818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7000/0xf7565228e460f260 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9cca7 expref: 18 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117593.841262:0:14818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b87a3840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14818:1876025385526656:192.168.206.37@tcp:105: 00000100:00100000:2.0:1789117593.841554:0:14818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17870ece40 going to sleep for 11 seconds 00000100:00100000:2.0:1789117593.846071:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117593.846225:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362477696 00000100:00100000:1.0:1789117593.846233:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362477696 00000100:00100000:1.0:1789117593.846284:0:14820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 10 00000100:00100000:1.0:1789117593.846295:0:14820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1798170050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+19:14704:x1876025362477696:12345-192.168.206.37@tcp:49:dd.0 00000100:00100000:1.0:1789117593.846465:0:14820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1798170050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+19:14704:x1876025362477696:12345-192.168.206.37@tcp:49:dd.0 Request processed in 171us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117593.846473:0:14820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 10 00000100:00100000:0.0:1789117593.846599:0:14818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b87a3840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14818:1876025385526656:192.168.206.37@tcp:105: 00010000:00010000:0.0:1789117593.846622:0:14818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f259 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.846631:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c16829c7800/0xf7565228e460f259 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.846673:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460f301 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.846703:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460f301 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.846714:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460f301 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.846724:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460f301 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.846730:0:14818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460f301 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.846736:0:14818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460f301 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.846742:0:14818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2045000 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117593.846745:0:14818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460f301 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.846753:0:14818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460f301 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.846762:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1782c0e200) 00010000:00010000:0.0:1789117593.846765:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789117593.846768:0:14818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460f301 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.846773:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045000/0xf7565228e460f301 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.846783:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460f2f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.846796:0:14818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460f2f3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.846801:0:14818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460f2f3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.846806:0:14818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457ec00 already unused, calling callback (ffffffffc210b4f0) 00010000:00010000:0.0:1789117593.846808:0:14818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460f2f3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.846814:0:14818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460f2f3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.846823:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1782c0e200) 00010000:00010000:0.0:1789117593.846825:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789117593.846828:0:14818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460f2f3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.846833:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c178457ec00/0xf7565228e460f2f3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117593.847027:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c087a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+18:14705:x1876025362477440:12345-192.168.206.37@tcp:57:lhsmtool_posix.0 Request processed in 19233us (19513us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1789117593.847035:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 53 00000020:00080000:0.0:1789117593.847039:0:14818:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789117593.847327:0:14852:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789117593.847332:0:14852:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789117593.847387:0:14852:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789117593.847394:0:14852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789117593.849265:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117593.849855:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362477952 00000100:00100000:0.0:1789117593.849864:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362477952 00000100:00100000:0.0:1789117593.849922:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 11 00000100:00100000:0.0:1789117593.849932:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0256d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+18:14705:x1876025362477952:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789117593.850635:0:14821:0:(mdd_object.c:4024:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789117593.854320:0:14821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1789117593.854434:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460f308 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.854452:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460f308 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.854464:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460f308 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.854472:0:14821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460f308 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.854479:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460f308 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.854486:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460f308 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117593.854507:0:14821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789117593.854621:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0256d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+20:14705:x1876025362477952:12345-192.168.206.37@tcp:35:lhsmtool_posix.0 Request processed in 4686us (5359us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1789117593.854630:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 11 00000020:00080000:0.0:1789117593.854635:0:14821:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789117593.855501:0:14806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789117593.855511:0:14806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460f308 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.855521:0:14806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2045600 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117593.855525:0:14806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460f308 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.855534:0:14806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460f308 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.855565:0:14806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1788d9ed00) 00010000:00010000:2.0:1789117593.855568:0:14806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789117593.855573:0:14806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460f308 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.855579:0:14806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c17c2045600/0xf7565228e460f308 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117593.855596:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117593.855598:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117593.855600:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117594.041327:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:0.0:1789117594.041846:0:15507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362478080 00000100:00100000:0.0:1789117594.041857:0:15507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362478080 00000100:00100000:0.0:1789117594.041929:0:15507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 0 00000100:00100000:0.0:1789117594.041940:0:15507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+8:2351:x1876025362478080:12345-192.168.206.37@tcp:4:dd.0 00010000:00010000:0.0:1789117594.041976:0:15507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c395bc/0xf7565228e460f30f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117594.042003:0:15507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ceb9cf7e/0xf7565228e460f2de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccd1 expref: 8 pid: 15504 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117594.042012:0:15507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789117594.042016:0:15507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789117594.042021:0:15507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c395bc/0xf7565228e460f30f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117594.042057:0:15507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ceb9cf7e/0xf7565228e460f2de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccd1 expref: 8 pid: 15504 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117594.042071:0:15507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ceb9cf7e/0xf7565228e460f2de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccd1 expref: 8 pid: 15504 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117594.042087:0:15507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c087ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:15507:1876025385526784:192.168.206.37@tcp:104: 00000100:00100000:0.0:1789117594.042172:0:15507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c17a0318b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789117594.042833:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117594.042927:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117594.043004:0:15508:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789117594.043012:0:15508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1789117594.043096:0:15509:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789117594.043109:0:15509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362478208 00000100:00100000:1.0:1789117594.043115:0:15509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362478208 00000100:00100000:1.0:1789117594.043150:0:15509:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789117594.043155:0:15509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362478336 00000100:00100000:1.0:1789117594.043158:0:15509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362478336 00000100:00100000:2.0:1789117594.048576:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 1 00000100:00100000:2.0:1789117594.048596:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c02552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+10:2351:x1876025362478208:12345-192.168.206.37@tcp:4:dd.0 00010000:00010000:2.0:1789117594.048642:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061eb7368/0xf7565228e460f316 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117594.048674:0:17046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117594.048679:0:17046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117594.048683:0:17046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061eb7368/0xf7565228e460f316 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117594.048694:0:17046:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000061eb7368/0xf7565228e460f316 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117594.051113:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117594.051202:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:1.0:1789117594.051274:0:15509:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1789117594.051285:0:15509:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1789117594.051313:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362478720 00000100:00100000:1.0:1789117594.051321:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362478720 00010000:00010000:1.0:1789117594.051369:0:14802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ceb9cf7e/0xf7565228e460f2de lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccd1 expref: 11 pid: 15504 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117594.051433:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 14 00000100:00100000:1.0:1789117594.051443:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+11:2350:x1876025362478720:12345-192.168.206.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117594.051467:0:14802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117594.051489:0:14802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ceb9cf7e/0xf7565228e460f2de lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccd1 expref: 11 pid: 15504 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117594.051514:0:14802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ceb9cf7e/0xf7565228e460f2de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccd1 expref: 11 pid: 15504 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117594.051538:0:14802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117594.051542:0:14802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117594.051548:0:14802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4c395bc/0xf7565228e460f30f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117594.051557:0:14802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c395bc/0xf7565228e460f30f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117594.051565:0:14802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117594.051568:0:14802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117594.051571:0:14802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000061eb7368/0xf7565228e460f316 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117594.051578:0:14802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061eb7368/0xf7565228e460f316 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117594.051599:0:14802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117594.051645:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+11:2350:x1876025362478720:12345-192.168.206.37@tcp:103:ldlm_bl.0 Request processed in 203us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117594.051658:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 14 00010000:00010000:3.0:1789117594.052132:0:15507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ceb9cf7e/0xf7565228e460f2de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.37@tcp remote: 0x4ce901a66dd9ccd1 expref: 10 pid: 15504 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117594.052149:0:15507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c087ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:15507:1876025385526784:192.168.206.37@tcp:104: 00010000:00010000:3.0:1789117594.052169:0:15507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4c395bc/0xf7565228e460f30f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.052178:0:15507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4c395bc/0xf7565228e460f30f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.052184:0:15507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c395bc/0xf7565228e460f30f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117594.054691:0:17046:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000061eb7368/0xf7565228e460f316 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117594.054716:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061eb7368/0xf7565228e460f316 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117594.055665:0:15509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362478464 00000100:00100000:1.0:1789117594.055675:0:15509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362478464 00000100:00100000:2.0:1789117594.060569:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117594.061194:0:15508:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1789117594.061204:0:15508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362478592 00000100:00100000:3.0:1789117594.061218:0:15508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362478592 00000100:00100000:2.0:1789117594.061801:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117594.061819:0:15508:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789117594.061827:0:15508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362478848 00000100:00100000:2.0:1789117594.061831:0:15508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362478848 00000100:00100000:2.0:1789117594.062805:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117594.062823:0:15508:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789117594.062829:0:15508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362478976 00000100:00100000:2.0:1789117594.062833:0:15508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362478976 00000100:00100000:2.0:1789117594.063820:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:3.0:1789117594.064449:0:15509:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789117594.064565:0:15508:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789117594.064574:0:15508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362479104 00000100:00100000:0.0:1789117594.064580:0:15508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362479104 00000100:00100000:1.0:1789117594.069737:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 2 00000100:00100000:1.0:1789117594.069766:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17c0257840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:07947d2f-ef96-4aa5-be78-0cb12cc06f21+16:2351:x1876025362478336:12345-192.168.206.37@tcp:4:dd.0 00010000:00010000:1.0:1789117594.069809:0:17047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e9b095c/0xf7565228e460f31d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117594.069825:0:17047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117594.069829:0:17047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117594.069835:0:17047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e9b095c/0xf7565228e460f31d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117594.069850:0:17047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e9b095c/0xf7565228e460f31d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789117594.172595:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:1.0:1789117594.172615:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1789117594.172621:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:1.0:1789117594.172832:0:17046:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:1.0:1789117594.172836:0:17046:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1789117591 -> 1789117593 00002000:00010000:1.0:1789117594.172839:0:17046:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789117591 -> 1789117593 00002000:00010000:1.0:1789117594.172841:0:17046:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:1.0:1789117594.172855:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061eb7368/0xf7565228e460f316 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117594.172867:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061eb7368/0xf7565228e460f316 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117594.172875:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061eb7368/0xf7565228e460f316 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117594.172898:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457e800 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:1.0:1789117594.172903:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061eb7368/0xf7565228e460f316 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117594.172911:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061eb7368/0xf7565228e460f316 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117594.172928:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061eb7368/0xf7565228e460f316 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117594.172935:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061eb7368/0xf7565228e460f316 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789117594.173165:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c02552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+16:2351:x1876025362478208:12345-192.168.206.37@tcp:4:dd.0 Request processed in 124571us (130330us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789117594.173176:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 1 00000100:00100000:1.0:1789117594.173207:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 3 00000100:00100000:1.0:1789117594.173217:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+15:2351:x1876025362478464:12345-192.168.206.37@tcp:4:dd.0 00010000:00010000:1.0:1789117594.173247:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6d668fa/0xf7565228e460f324 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117594.173259:0:17046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117594.173263:0:17046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789117594.173269:0:17046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6d668fa/0xf7565228e460f324 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117594.173292:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6d668fa/0xf7565228e460f324 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.178629:0:15507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c395bc/0xf7565228e460f30f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.178648:0:15507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c395bc/0xf7565228e460f30f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.178658:0:15507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c395bc/0xf7565228e460f30f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.178665:0:15507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c17c2045000 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117594.178670:0:15507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c395bc/0xf7565228e460f30f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.178679:0:15507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c395bc/0xf7565228e460f30f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.178698:0:15507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c395bc/0xf7565228e460f30f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.178706:0:15507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c395bc/0xf7565228e460f30f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117594.178803:0:15507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+14:2351:x1876025362478080:12345-192.168.206.37@tcp:4:dd.0 Request processed in 136861us (137481us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1789117594.178813:0:15507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 0 00000100:00100000:3.0:1789117594.178845:0:15507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 4 00000100:00100000:3.0:1789117594.178857:0:15507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+13:2351:x1876025362478592:12345-192.168.206.37@tcp:4:dd.0 00010000:00010000:3.0:1789117594.178898:0:15507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d26c4eb8/0xf7565228e460f32b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.178910:0:15507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117594.178914:0:15507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117594.178920:0:15507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d26c4eb8/0xf7565228e460f32b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.180293:0:15507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d26c4eb8/0xf7565228e460f32b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117594.245549:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789117594.248361:0:17047:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:2.0:1789117594.248370:0:17047:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1789117594.248383:0:17047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e9b095c/0xf7565228e460f31d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117594.248395:0:17047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e9b095c/0xf7565228e460f31d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117594.248431:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e9b095c/0xf7565228e460f31d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117594.248438:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442f400 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117594.248455:0:17047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e9b095c/0xf7565228e460f31d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117594.248463:0:17047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e9b095c/0xf7565228e460f31d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117594.248481:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e9b095c/0xf7565228e460f31d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117594.248487:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e9b095c/0xf7565228e460f31d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117594.248561:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17c0257840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:07947d2f-ef96-4aa5-be78-0cb12cc06f21+18:2351:x1876025362478336:12345-192.168.206.37@tcp:4:dd.0 Request processed in 178799us (205629us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789117594.248570:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 2 00000100:00100000:2.0:1789117594.248596:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 5 00000100:00100000:2.0:1789117594.248608:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:07947d2f-ef96-4aa5-be78-0cb12cc06f21+17:2352:x1876025362478848:12345-192.168.206.37@tcp:4:dd.0 00010000:00010000:2.0:1789117594.248639:0:17047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f6bf7dc/0xf7565228e460f332 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117594.248650:0:17047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117594.248665:0:17047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789117594.248672:0:17047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f6bf7dc/0xf7565228e460f332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117594.248683:0:17047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f6bf7dc/0xf7565228e460f332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789117594.258599:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000001:00080000:0.0:1789117594.308921:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:3.0:1789117594.309625:0:15507:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:3.0:1789117594.309631:0:15507:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:3.0:1789117594.309645:0:15507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d26c4eb8/0xf7565228e460f32b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.309669:0:15507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d26c4eb8/0xf7565228e460f32b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.309678:0:15507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d26c4eb8/0xf7565228e460f32b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.309685:0:15507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c6400 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117594.309689:0:15507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d26c4eb8/0xf7565228e460f32b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.309698:0:15507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d26c4eb8/0xf7565228e460f32b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.309728:0:15507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d26c4eb8/0xf7565228e460f32b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.309736:0:15507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d26c4eb8/0xf7565228e460f32b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117594.309825:0:15507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+13:2351:x1876025362478592:12345-192.168.206.37@tcp:4:dd.0 Request processed in 130968us (249260us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789117594.309834:0:15507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 4 00000100:00100000:3.0:1789117594.309863:0:15507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 6 00000100:00100000:3.0:1789117594.309874:0:15507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b87a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+12:2351:x1876025362478976:12345-192.168.206.37@tcp:4:dd.0 00010000:00010000:3.0:1789117594.309904:0:15507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000654036f5/0xf7565228e460f339 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.309915:0:15507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117594.309920:0:15507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117594.309926:0:15507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000654036f5/0xf7565228e460f339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.309938:0:15507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000654036f5/0xf7565228e460f339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.310308:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6d668fa/0xf7565228e460f324 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.310328:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6d668fa/0xf7565228e460f324 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.310334:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6d668fa/0xf7565228e460f324 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.310349:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178442f000 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117594.310352:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6d668fa/0xf7565228e460f324 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.310359:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6d668fa/0xf7565228e460f324 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.310371:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6d668fa/0xf7565228e460f324 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.310378:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6d668fa/0xf7565228e460f324 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117594.310441:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+12:2351:x1876025362478464:12345-192.168.206.37@tcp:4:dd.0 Request processed in 137226us (259335us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1789117594.310449:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 3 00000100:00100000:3.0:1789117594.310466:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 7 00000100:00100000:3.0:1789117594.310473:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b85c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+11:2352:x1876025362479104:12345-192.168.206.37@tcp:4:dd.0 00010000:00010000:3.0:1789117594.310490:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009192ace3/0xf7565228e460f340 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.310503:0:17046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117594.310506:0:17046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789117594.310511:0:17046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009192ace3/0xf7565228e460f340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.310520:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009192ace3/0xf7565228e460f340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789117594.354837:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:3.0:1789117594.355233:0:17047:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:3.0:1789117594.355239:0:17047:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:3.0:1789117594.355254:0:17047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f6bf7dc/0xf7565228e460f332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.355266:0:17047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f6bf7dc/0xf7565228e460f332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.355276:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f6bf7dc/0xf7565228e460f332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.355285:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c178457ee00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:3.0:1789117594.355290:0:17047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f6bf7dc/0xf7565228e460f332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.355310:0:17047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f6bf7dc/0xf7565228e460f332 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.355354:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f6bf7dc/0xf7565228e460f332 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117594.355363:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f6bf7dc/0xf7565228e460f332 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789117594.355483:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:07947d2f-ef96-4aa5-be78-0cb12cc06f21+13:2352:x1876025362478848:12345-192.168.206.37@tcp:4:dd.0 Request processed in 106874us (293681us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789117594.355493:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 5 00000001:00080000:3.0:1789117594.409251:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:0.0:1789117594.409475:0:15507:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:0.0:1789117594.409491:0:15507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000654036f5/0xf7565228e460f339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117594.409523:0:15507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000654036f5/0xf7565228e460f339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117594.409531:0:15507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000654036f5/0xf7565228e460f339 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117594.409538:0:15507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c7a00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:0.0:1789117594.409542:0:15507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000654036f5/0xf7565228e460f339 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117594.409551:0:15507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000654036f5/0xf7565228e460f339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117594.409569:0:15507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000654036f5/0xf7565228e460f339 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117594.409577:0:15507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000654036f5/0xf7565228e460f339 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789117594.409676:0:15507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b87a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+7:2351:x1876025362478976:12345-192.168.206.37@tcp:4:dd.0 Request processed in 99801us (346871us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789117594.409686:0:15507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 6 00010000:00010000:2.0:1789117594.409989:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009192ace3/0xf7565228e460f340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117594.410000:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009192ace3/0xf7565228e460f340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117594.410007:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009192ace3/0xf7565228e460f340 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117594.410015:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c16829c6c00 already unused, calling callback (ffffffffc16b5550) 00010000:00010000:2.0:1789117594.410018:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009192ace3/0xf7565228e460f340 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117594.410026:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009192ace3/0xf7565228e460f340 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117594.410037:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009192ace3/0xf7565228e460f340 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117594.410045:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009192ace3/0xf7565228e460f340 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789117594.410088:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b85c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:07947d2f-ef96-4aa5-be78-0cb12cc06f21+5:2352:x1876025362479104:12345-192.168.206.37@tcp:4:dd.0 Request processed in 99614us (346271us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789117594.410105:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 7 00010000:00010000:2.0:1789117595.276971:0:16231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789117595.827947:0:17086:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1789117596.293822:0:14806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117596.743527:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17c01ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385526912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117596.743606:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117596.743660:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117596.743667:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b7af12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385527040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117596.743688:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117596.743715:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385526912 00000100:00100000:3.0:1789117596.743720:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385526912 00000100:00100000:3.0:1789117596.743756:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385527040 00000100:00100000:3.0:1789117596.743759:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385527040 00000100:00100000:3.0:1789117596.743775:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789117596.743783:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385526912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789117596.743815:0:15506:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789117596.743866:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385526912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117596.743873:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789117596.743895:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789117596.743901:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385527040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117596.743918:0:15506:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789117596.743941:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876025385527040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117596.743947:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789117596.743987:0:3298:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1789117596.743992:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c17b87a3c00, transno 8589934595 00000004:00080000:3.0:1789117596.744002:0:3298:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1789117596.744026:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b7af12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385527040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117596.744039:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17c01ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876025385526912:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789117596.744068:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789117596.744072:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789117596.747784:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117596.747860:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789117596.747881:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681ef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385527296:0@lo:400:kworker.0 00000100:00100000:3.0:1789117596.747948:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117596.748011:0:15529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385527296 00000100:00100000:3.0:1789117596.748017:0:15529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385527296 00000100:00100000:3.0:1789117596.748063:0:15529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789117596.748072:0:15529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385527296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117596.748119:0:15529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876025385527296:12345-0@lo:400:kworker.0 Request processed in 48us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117596.748126:0:15529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789117596.748168:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681ef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876025385527296:0@lo:400:kworker.0 00000100:00100000:1.0:1789117596.752874:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c17b85c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3301:1876025385527168:0@lo:400:kworker.0 00000100:00100000:1.0:1789117596.752956:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117596.753119:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385527168 00000100:00100000:0.0:1789117596.753127:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385527168 00000100:00100000:0.0:1789117596.753170:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789117596.753191:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:3301:x1876025385527168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117596.753486:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681ef30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385527424:0@lo:400:kworker.0 00000100:00100000:3.0:1789117596.753565:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c1681ef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876025385527552:0@lo:400:kworker.0 00000100:00100000:0.0:1789117596.753863:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33b28d55-0a9c-4af4-874e-7f0dcd5828d4+19:3301:x1876025385527168:12345-0@lo:400:kworker.0 Request processed in 671us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117596.753872:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789117596.754242:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c17b85c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33b28d55-0a9c-4af4-874e-7f0dcd5828d4:3301:1876025385527168:0@lo:400:kworker.0 00000100:00100000:2.0:1789117596.754337:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117596.755118:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117596.755348:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385527424 00000100:00100000:1.0:1789117596.755355:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385527424 00000100:00080000:3.0:1789117596.755470:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117596.755824:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025385527552 00000100:00100000:1.0:1789117596.755829:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025385527552 00000100:00100000:0.0:1789117596.755928:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789117596.755938:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385527424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117596.756014:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876025385527424:12345-0@lo:400:kworker.0 Request processed in 78us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117596.756022:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789117596.756037:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789117596.756043:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b7af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876025385527552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117596.756073:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b7af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876025385527552:12345-0@lo:400:kworker.0 Request processed in 31us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117596.756079:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1789117596.756126:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117596.756156:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681ef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876025385527552:0@lo:400:kworker.0 00000100:00100000:2.0:1789117596.756340:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c1681ef30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876025385527424:0@lo:400:kworker.0 00000100:00100000:2.0:1789117596.826015:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117596.826057:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117596.826089:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117596.826116:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117596.826137:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117596.826157:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117596.826179:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.37@tcp (source: 12345-192.168.206.37@tcp) 00000100:00100000:2.0:1789117596.826202:0:15503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362479616 00000100:00100000:2.0:1789117596.826210:0:15503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362479616 00000100:00100000:2.0:1789117596.826257:0:15503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362479872 00000100:00100000:2.0:1789117596.826260:0:15503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362479872 00000100:00100000:2.0:1789117596.826272:0:15503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362479488 00000100:00100000:2.0:1789117596.826274:0:15503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362479488 00000100:00100000:2.0:1789117596.826284:0:15503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362480000 00000100:00100000:2.0:1789117596.826287:0:15503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362480000 00000100:00100000:2.0:1789117596.826301:0:15503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 10 00000100:00100000:2.0:1789117596.826309:0:15503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+5:2350:x1876025362479616:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117596.826387:0:15503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+5:2350:x1876025362479616:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 78us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117596.826395:0:15503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 10 00000100:00100000:2.0:1789117596.826449:0:15503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 11 00000100:00100000:2.0:1789117596.826456:0:15503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28194745-e310-497c-8221-affa7d89f6fa+5:2350:x1876025362479872:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117596.826483:0:15503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28194745-e310-497c-8221-affa7d89f6fa+5:2350:x1876025362479872:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 28us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117596.826489:0:15503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 11 00000100:00100000:2.0:1789117596.826501:0:15503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 12 00000100:00100000:2.0:1789117596.826507:0:15503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+5:2350:x1876025362479488:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117596.826528:0:15503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07947d2f-ef96-4aa5-be78-0cb12cc06f21+5:2350:x1876025362479488:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 22us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117596.826533:0:15503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 12 00000100:00100000:2.0:1789117596.826542:0:15503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 13 00000100:00100000:2.0:1789117596.826547:0:15503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28194745-e310-497c-8221-affa7d89f6fa+5:2350:x1876025362480000:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117596.826562:0:15503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28194745-e310-497c-8221-affa7d89f6fa+5:2350:x1876025362480000:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 15us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117596.826567:0:15503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 13 00000100:00100000:2.0:1789117596.826582:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362479232 00000100:00100000:2.0:1789117596.826586:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362479232 00000100:00100000:2.0:1789117596.826607:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 123 00000100:00100000:2.0:1789117596.826613:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17bbccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:2350:x1876025362479232:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117596.826637:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17bbccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edde4d4f-1af6-41f8-b360-b9a2dcbe220a+13:2350:x1876025362479232:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 24us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117596.826644:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 123 00000100:00100000:2.0:1789117596.826676:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362479360 00000100:00100000:2.0:1789117596.826681:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362479360 00000100:00100000:2.0:1789117596.826709:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025362479744 00000100:00100000:2.0:1789117596.826711:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025362479744 00000100:00100000:2.0:1789117596.826731:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 29 00000100:00100000:2.0:1789117596.826738:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+20:2350:x1876025362479360:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117596.826785:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07947d2f-ef96-4aa5-be78-0cb12cc06f21+20:2350:x1876025362479360:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 47us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117596.826792:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 29 00000100:00100000:2.0:1789117596.826804:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.37@tcp, seq: 30 00000100:00100000:2.0:1789117596.826810:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c17b885e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28194745-e310-497c-8221-affa7d89f6fa+6:2350:x1876025362479744:12345-192.168.206.37@tcp:400:kworker.0 00000100:00100000:2.0:1789117596.826836:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c17b885e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28194745-e310-497c-8221-affa7d89f6fa+6:2350:x1876025362479744:12345-192.168.206.37@tcp:400:kworker.0 Request processed in 26us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117596.826842:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.37@tcp, seq: 30 00000100:00080000:2.0:1789117596.826857:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789117596.826861:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789117596.826863:0:14813:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 Debug log: 29663 lines, 29663 kept, 0 dropped, 0 bad.